AFAIK at least the later Roman bath facilities were supplied directly from the aqueducts, which meant that there would have been a constant flow of water into (and logically, out of) the pools - for despite all their engineering skills, the Romans' plumbing technology lacked valves; it was infact impossible to stop the water running.