Try rotating some of your buildings. I think it unlikely that a village this size would have a strict policy of orienting buildings strictly to the compass.
Imagine driving a cart through the town down the Forest Road. Given that the cart will be somewhat wider than a horse (the horse, by the way, gives us the only scale reference available on this map), so it would probably be a very tight fit to maneuver one between Alin Baras' house and that hut to the west of it.
Also, the shadows on the forest are falling to the left, but all the other shadows fall to the right.
edit: Whoops! Guess I commented on the Finished Map forum instead of the WIP. Mea culpa.