OP: just skip to season 4 and save some some trouble
^^this
In my recent rewatches, early-VOY has been inconsistent at the most unexpected of times. Despite some really good episodes in among the mixed bags or outright bad stories, VOY - IMHO - didn't really find its way until "Scorpion" and that's when its newfound purpose really begins to take off. I'd almost recommend skipping to "Scorpion", moving forward, then returning to the early stuff. (Even then, some inconsistencies with even the technobabble at times still feel like it's rubberstamped autopilot at best or grating at worst. Even with that, roll with it and the pros of various episodes still elevate what seemingly doesn't.)