Be sure to also look at the objects Mental Ray settings just below the Render Stats and turn of Visible in Transparency. Otherwise it will show up when you try to render anything with transparency.