Lots of secret passages to get from one level/room to another without having to be seen. Especially one that goes from the bedchamber to another bedchamber for the king's uh....entertainment.

You also have to have a secret passage to exit the castle in case it is ever lost to invaders. Preferably near horses or a ship for a rapid getaway.