When you perform a smooth operation, it uses something called the Catmull-Clark algorithm. This algorithm will always result in quadrilateral faces. If small faces like the ones you're seeing occur, it means that there are some unmerged, floating vertices in the mesh.