I like how this is coming along. The overall page balance is great, I think flipping the inset would change that as you seemed to have noticed when you tried it. You wouldn't really have to change the entrance location if you were to add a compass to both the map and the inset clearly showing the different north direction, maybe?
I think your subtle coloring is turning out very well, a muted palette on this page would fit very well.