Well the line is something like the "That was three hundred and nine years ago" at least in relation to when they left their homeworld. Which would place it aroud 2066 almost a full century before the Federaton was founded. Now I guess they could have wandered the galaxy for those 95 years. But there is nothing to suggest that the Ba'ku normally age any differently than humans