Neat Idea ...
And especially neat world (yet ambitious and promising to quite a challenge ...)

This concept makes me think of J. G. Ballard's short story, "concentration city" ... a must read !

Good luck with the project !
If I was to set myself on such a project, I guess I'll reason the whole city in neighbourhoods or districts, each with its own character, feel, density, and urban fabric, assumingly depending on the mood of these golems, at the time they were building said district ...