I'm pretty sure it's stated in Amok Time or ST: TSFS, Vulcans under go Pon Farr every 7th year of their adult life. And we know it is 15 - 16 years from Amok Time to ST:TSFS. So he would have to have had 1 or 2 Pon Farr episodes since then. I guess he could have found any woman and not been married. But that would be out of character.
On another note, I remember reading somewhere that Saavik is pregnant in ST: TVH. But if you count the novelization for ST: TSFS, it could be Spocks or Davids child. I never read the novel for TVH. It wasn't one of my favorite films.