the problem isn't that you're getting reflections in your text object, it's that it's showing what would be behind your object in the IBL sphere...

only other thing i can think of is that i've got the reflections turned down to 0.000 on my object, but i don't think it's related to this problem.