I've never deleted my target objects... just hid them. Afterall, if any change to the blend shape needs to be done, I can just edit the offensive target and it automatically updates.

If you want to remove the blend shapes, you can do so in the Blend Shape aniamtion editor window.