Also, I don't know if others have this problem. But when I have tried setting up the references I would get weird camera issues where the camera would get stuck and I would have other weird anomalies.

So, to solve this, I read that it was best to create a duplicate set of cameras for all the original cameras.

Then insert the reference images into the duplicate cameras, and then select those as your standard views for each different view.