I have also experienced lots of problem when I'm working with booleans on more complexed objects. My advice are that you try to do the boolean operations early in your modeling process, when your model are fairly simple. One funny thing are that if the faces are in the wrong direction difference may work like union, and the opposite. But don't mind to reverse the faces - just try other options until you find the one you want.