You know I happen to agree..it's nice to see that Voyager haters of the past come back like years later and watch the series again and then start to get hooked on it.
I was basically the same way. Years 1-4 really stuck out for me..but when Year 5 came around, it started to dull a bit for some reason(even though I still loved the series as a whole). Year 7 was the worst for me..I guess because I was realizing that it was gonna be over soon and it really got to me. Especially when Neelix left! At first I thought: oh this is a joke..he'll come back later on. But when he REALLY left, it made me realize that uh-oh, this series is fixing to go bye-bye. And it killed me when it ended!!!! Then I said: wait, THAT'S the END?!?! What are you kidding me?!?! Suffice to say, it didn't end like I wanted it too. But that's what fanfic is for.