a poly square won't work because it has to be a curve (nurbs). To attach the 4 sides together, use Edit Curve > Attach. In the options, use the Connect option instead of Blend. Do this for the first 3 corners. For the 4th, it won't work. you'd have to use Open/Close Curve for the last corner.