you may need to parent the shader node to shape node to prevent this from happening. Either that you maybe baking the material that contains the bump?