If there was some very strong rock, this situation could last a while though? I am thinking thousands of years. Maybe more. It takes a long time for a river to wear down stone and carve a path through it I think.
So throw some strong rock into the hills and you are golden