There was the recovery time, for sure, but I always got the impression that time in Elven lands passed a little differently to those in them than to those outside...I think they might have said so explicitly. I don't know the dates but I expect they were in Lothlorian for a similarly extended time?
M