It seems that the problem was with the HIK controllers themselves. You can toggle between full body, part body, and selection. I was unaware of this. When full body is selected and you set a keyframe, it keys everything in the skeleton chain. Clicking on body part allowed me to just keyframe the parts i wanted. Finding that out fixed the problem!