He has told us he bolted after being elected President
When was this?
He certainly bolts at the end of "The Five Doctors" when Flavia says that Gallifrey needs him. And I suppose that his line to Tegen could imply that his original departure was for similar reasons. That said, we don't actually know why the Doctor left Gallifrey originally.