Oh, I didn't so much mean that the spiral staircases would be tiresome, more that having to go up 4-5 levels to serve dinner to the queen in her quarters... ouch.

Also, I didn't mean for you to fill in the courtyard - I was suggesting maybe leaving the walls around the courtyard lower (like, two levels or so?), and let the main tower grow above it.

As for escape routes, you do have the exit down to the caves below, yes?

I do think moving at least some of the troops to level 1 would benefit the daily life of the inhabitants.

How many people live there again? Maybe you don't need an entire floor for the kitchen.