i'm not convinced you need cloth.

i doubt the head is going to deform the same way the arms and body would, so you can just model the bandana as a static object parented to the head.

as for the extra edge loops, just select every second edge or something, hold shift, right click and hit 'delete edge'. provided you didn't delete any crucial edges (namely those on the UV seams) you should be fine.