its definetly the matting. you may be missing a step or something. Another thing it seems like your camera color is the sky color can you just render out the flower layers on a black camera environment this may help.