I think it has to do with the face's pivot point(s). If you place the pivot of each face in the middle of the face, it should go right (I guess).
Also it's a good idea to group them before scaling.