have you tried using a mesh consraint. all you have to do is make sure your in the cloth menu set then select the verticies of your cloth then shift select the solid object or in your case the armor then click the mesh constraint button and that should connet the two togather