Without knowing very much about how you setup your geometry, groups, and your scene in general, the only thing I can think of is to adjust the "mass" attribute on both of your objects.

Set it pretty high.