there is an area in Mental Ray Globals for setting the size limit of the Render Job. Like how much RAM Mental Ray can use or something like that.
