You've seemly run into some gamma problems. It's an issue that comes up quite a bit when working with the physical sky. I did a blog post about it.