hehe, fun idea... if you wanna go a little more serious, try searching for castle floor plans in here (or on google) and make a castle from those. For some extra input to your current project, how about some connecting bridges or such between the buildings