The issue is indeed with the keyframes. Once the animation starts, it looks up the location specified by the keyframe and snaps to that location. There are two things you can do to fix this.

1) As...