hmm, I don't know if I'm visualizing your problem correctly.

Perhaps, you need to use the Global mode rather than Local? It's that little circle icon on the extrude face gizmo.