Yes, you're right! They're that large, that the citizenz of Port Sol built whole palaces inside the walls! The halls within the walls are sealed since some terrible things happened in the past).
Right now I'm thinking about the right way to make them actually look that way. I guess I'll built a few newer structures on top of them (the keep of an excentric pirate captain, for example).