Deleting the faces doesn't help, it hurts. Check out the image attached. And edge loops can't be added to this one. Going back to keeping those "extra" edges unless someone's got another idea.