Not really too sure off the top of my head, have you got Caustics on? asthe causitc photons might be too large and causing the problem.
I know its a bit of a lame answer but the help files go over mental rag GI and causitcs problems and how to sor them out, and I think that this type of problem is one example.
"No pressure, no diamonds" Thomas Carlyle