As a couple of people have said, Voyager, and even moreso with Enterprise, have nearly been forgotten by the non-Trek audience. To be honest, my opinion of Voyager post season 4 has really gone down the last few years, and I've heard that sentiment echoed from various people.
Here in Britain, Voyager benefitted during the late 90's from a regular weeknight slot on BBC2. The same time for nearly a decade, between 6 - 7.30pm evenings opposite the BBC1 news. A location trailblazed by TNG, DS9 and TOS. When Enterprise was launched, BBC lost out in a bidding war with Channel 4 (who also paid more for The Simpsons). That act signalled the end of audience figures around 2 - 3 million at peak time, with fans eager to get home after work to tune in. They split up a successful schedule formula - Simpsons and Trek back-to-back. Enterprise was mixed into a Sunday T4 afternoon, treated mostly with disdain by the presenters, more interested in interviewing Britney Spears or catching up with Dawson's Creek. The show was in the wrong line up amidst all those teen shows. Nobody knew where to put it. Enterprise looked like mutton dressed as lamb... clearly the odd one out on T4. In addition they treated it shabbily, heavily editing it for language and violence. That failure to understand the programme's audience and find the right timeslot, no doubt killed any possibility of Channel 4 showing Battlestar Galactica too. The last glimpse of Star Trek in the schedules was BBC2 consigning reruns of the Original and Next Generation in the wee small hours of Saturday morning.
Not being American, I don't know much about UPN's strategy with Voyager and Enterprise. Although I understand the situation was similiar, a familiar fixture being messed around in the schedules, then finally squeezed out by a network catering less and less for Sci Fi.
I often wonder how well Enterprise would have faired on BBC2, free from adverts, patronising amateurish presenters and on during peak time. Well, I don't need to guess... judging by the endless promoting Heroes gets for its weeknight 9pm showing.
Ahhh, the good old days of BBC2's almost religious loyalty to Trek. TNG on Wendesday, DS9 Thursday, TOS Friday and Voyager on a Sunday - until that one day they took it off for some documentary about Bolton Stadium closing, then it disappeared for six months
Channel 4's treatment of Enterprise was abysmal considering all the fuss they made over being Britain's only terrestrial channel showing Brand New Trek.
It started off well enough - plenty of advertising, a decent timeslot (Monday or Tuesday at 6pm if I recall), E4 repeats. Then without warning they went "Channel 4" on it (like they did with King of the Hill, Norm, SG-1, Babylon 5 and a million other shows before it), by bouncing it round the schedule. I remember accidentally stumbling across a season 2 episode at 4:35am one night.
Without warning, it appeared on T4, and just like you said, was met with almost derision by the presenters. Sunday afternoon was just not an appropriate place for season 3 of Enterprise or SG-1, and the editing really hurt both shows.
It has to be said that while Sky One's advertising for it wasn't ideal, it did benefit from a stable timeslot, and Virgin1 has given it the best advertising I've seen for any Trek series. They actually seem genuinely excited to have it (though with a tongue-in-cheek reference to hating the theme tune

).
I think Virgin1 in the UK probably has done a lot for bringing interest in Voyager and Enterprise back to life, but it's still a far cry from the heady days of the late 90s/early 2000s.