The punches don't seem to have any follow through on the action. They just jerk back from what I presume is the point of impact.

Even if you punch a person, the force of the hit will cause the person to react backwards, and your fist will usually follow as well.

I'd slow down the action a tad in general.

Keep it up!