Also, there's no reason to assume the Nazis would have remained a presence in the 2060s or the 2160s. It would suffice that their brief histrionics in the mid-20th century changed something about the Earth that then either stayed changed, or then caused a cascade of events.
Say, first contact with Vulcans might have gone poorly if not for the fact that Earth was ravaged by WWIII and wasn't fielding a fleet of heavily armed space warships at the time. And that would certainly have meant no Federation, even if the last Nazi in that timeline died in 1991.
Timo Saloniemi