Hey Markus-
It sounds like you may be having a problem with anti-aliasing and your flood fill not quite getting all the fiddly bits that are a slightly different color around the edge. A simple solution is to flood fill multiple times until you're satisfied. If filling once doesn't quite get everything, filling three or four times will.

-Rob