I belive its a combination of both really. But most of all I think the lighting that makes a scene realistic. I have seen plenty of scenes that look realistic just in the wip stage where the models dont have any textures at all.
The other would have to be the surface of the object. Its specular, reflection, bump. And so on.'
FG & GI, is your key to realism i belive :p