after applying a smooth, you can take the smooth's divisions down to 0 in the channel box which essentially "removes" the smooth.

Animate like normal and then, before rendering, increase the divisions back up to what you want.