Your edge detector isn't symmetrical. I would guess that you're defining your own convolution matrix and are missing a sign. Or you're using the edge detect filter rather than Mexican Hat edge detect. The difference between the two is that Mexican Hat detects edges in all directions and edge detect only in a particular direction.