The verts that are moving are probably weighted to that joint, select the verts that move then go to the componant editor and set them to have 0 weighting on the joints.
Also when painting remember to never take away only ever add, otherwise things like this can happen (althought this may be form your inital bind)
"No pressure, no diamonds" Thomas Carlyle