I've been watching Voy again too. But I'm in the 5th season right now. I think the show gets weaker as it goes on. As the continuity problems appear (how many shuttles? lol). The endless resets after each ultra traumatic episode. The Voyager/First Contact-edition Borg (yuck). Seven of Nine's stupid outfit (she's a superb actress though). Excessive treknology deus ex machina life savers.
It's an ok show. It's entertaining. But it's really kinda weak overall. I just don't think that they had a plan for the show. They came up with stuff as they went and it showed.
You won't see me argue that any of the series are really "better than the rest" though. They have their own strengths and weaknesses (or share them).