The verts that are moving are probably weighted to that joint, select the verts that move then go to the componant editor and set them to have 0 weighting on the joints.

Also when painting remember to never take away only ever add, otherwise things like this can happen (althought this may be form your inital bind)