Perhaps some stairs up to the wall so that soldiers can get up there to defend it? Possibly a gatehouse or heavy door to protect those open entrances? A well (though that might be what you have in the SE corner)?

Looking good.