do you get something form the operation?

If you only get little bits from the difference then you've done it the wrong way round, select the object you want the thing to be removed from then the thing you want to invoke the differenct then do the operation.

Other than this as an explanation i'm stuck!