Check the attachment, its a playblast of my problem.

It's easier to understand my problem by the playblast, but for those who are lazy i'll try and explain... I'm curious, why when I have my cloth setup, and it seems to be working, that it seems to be attached to the suface (a nurbs ball) it recently collided with when the ball should be moving too fast for the cloth.

eg. a towel resting on a basketball that someone is holding... that person lets the ball drop, and the cloth should be left in the air, falling cause the ball is moving too fast...

Can anyone help?