Quadrangulate only works when the meshes are triangulated a particular way. If you want to fix it, I'm afraid you'll have to go in, and delete the triangles by hand.