Think with the hat you could just define it a bit, so to speak, take some of the blockeyness out of it (even though, like you say, its the thing really holding him to the character) but a bit of creasing bending etc would really match the characters other clothes and still keep in with the original character.