I disagree with pretty much everything you just said, I see it differently, but ok.
We can agree to disagree.
It's just that by my reckoning, he's piloted the TARDIS successfully far too many times for any other explanation to make any sense.
Of course, I am not afraid to have unusual and/or unpopular ideas about the show. I'm the guy whose pet theory is that the Doctor has always been a "Special Forces/James Bond" type of agent fighting the Time War, for the entire duration of the series beginning in 1963. Yes, even though RTD didn't invent the concept until 2005. Every episode of the original series was a "mission", we simply weren't privy to that knowledge. Quite a bit of the original series makes much more sense to me when viewed in that light.