Re: Season 4: Just how much of it can be called Fanwank?
Season 4 was too much too late, and it became the TOS-tie-in show rather than the show's original premise. It felt like a gimmick, and that's why so many people consider it "fanwank" rather than "continuity." Other episodes, like Daedalus, even blatantly ignored ENT continuity and illustrate that the show basically became TNG-lite, just like VOY did.
SOme might say (parts) that season 4 was the closest to it's premise,
On the continent of wild endeavour in the mountains of solace and solitude there stood the citadel of the time lords, the oldest and most mighty race in the universe looking down on the galaxies below sworn never to interfere only to watch.