I am pretty sure it has something to do with converting the object between poly's and subdiv's. I really would like to know why this is happening. I am not going to convert any object until I do so I don't have to go back and spend a hour fixing the object again.