the second option you had is very popular technique. Try to turn off everything in the rendering stats for the sky sphere except for primary visibility. This way it will not affect your model.