Voyager should have had a more difficult time in the Delta quadrant (but not depressing, misery levels of difficulty). It did end up being a pleasure cruise and needed to be somewhere closer to the middle ground. I also wanted more conflict with the Maquis; not because they were Maquis but because they were untrained, undisciplined non-Starfleet people who should have had less of a goody-goody Starfleet policy regarding how to get home.
My main gripe though has always been that the ship felt parochial. The crew just seemed small and bridge focused (understandable for a Trek show but if they're traveling for decades together, the lower ranks should have been more prominent). I wanted voyager to have a travelling community feel about it. Relationships and families being the norm on board. A sense that they really would be travelling for years and would have to band together to create a real family. Perhaps pick up others and turn into a convoy for some of the journey.
In the end, it was just the bridge crew, doing normal, formulaic Starfleet stuff as though they'd be home fairly soon. No big deal. Even episodes like
Twisted where everyone is apparently being pushed to the centre of the ship (Sandrines) didn't make much effort to create a tangible sense that this was a huge ship with a a huge crew. Despite being pushed to the centre by the anomaly, the only people who ended up at Sandrines were the bridge crew.