You can either manually move the pivot point back to where you think it should go, or you can go modify > center pivot. Not sure what you mean by the pivot point following the vertices and edges...