the reason they do that is because you are using the manipulator that happens when you extrude. When you are extruding just one edge, you can do that. Otherwise, just press the move button or press W and use that one.