plan your work better so you know what you are doing.
if you want to work on the fly like that, yes i think you will have to create it again.., so get it where you want it, do what needs to be done freezing it, whatever.., then work from that.
block it out first
create a camera so you can look through it and see the same scene from the same angle everytime
or key frame the perspective camera at 1.., that what if you move it yo just need to hit rewind and you are back inplace.
someone else might have a beter clue than me but it sounds like you need to make some clear decisions for yourself
take it easy and life will be easy