IMO no, Voyager never gets better. It gets worse.
Yes yes yes, we all know you were expecting the show to be about the crew falling to pieces within the first two episodes and spend the entire series hating and plotting to murder one another. At least in their spare time while the rest of it would comprise of them all becoming vicious bloodthirsty space pirates who revel in being free of the Federation and go around ravaging, destroying and stealing everything from every sentient race encountered (especially the nice ones who welcome them) because that's "more true to life" and "better drama" than people who decide to overcome their differences and accept the aid others give them.
They didn't do that, get over it.