My idea is that they were dwarves but living in a human city, and there even have some human followers (blacksmith and metal workers mainly) of Moradin attending.
But I also had the idea that a bigger subterranean complex also existed, for the clergy and the administration of the temple...