also you could model a poly object around the building then pin your object to certain areas around the model then your cloth sim