select the child and press shift+p to unparent instead of mmb draggin from the outliner. when working with big scnes u should work with the hypergraph instead.