I think when MOST people talk about Voyager ruining the Borg, they're thinking more about the crap we saw in the latter years rather than anything to do with Scorpion or Species 8472.
I feel that if Voyager's exploration of the Borg was limited to Scorpion
and Dark Frontier
, not as many people would be complaining. For me, Unimatrix Zero
is definitely where the Borg jumped the shark and Endgame
was where it did a triple somersault over it.