Perhaps you have alot of discarded things still in the "background" check the outliner to delete objects. But this should only be a problem if you have been working with the scene for a long time and grouped alot etc.