i agree kind of...

imo the IBL is just there for environment reflections but doesn't do any actual lighting. turn off FG and light it manually. I try not to use FG ever, and you will find that most people try to avoid it.

for a situation like this i.e studio lighting, it doesn't make sense for the reflections to be a kitchen or the uffizi probe or whatever.
I used to do the PC World adverts (the chrome numbers and letters) the light rig for that scene is generally spot lights in a 3 point lighting setup and a bunch of reflection cards. (these are just planes that are animated to move in front of the numbers. the primary visibility is turned off and they have ramps plugged into the colour of a surface shader or lambert or something. if you make the ramp black and white and grey and kind of stripy like a barcode or something, you could have a diagonal ramp or something.) i would have an IBL but it would just be black with some white spots on it where the studio lights would be.