To me, little things could have helped.
Like setting up the Chakotay/Seven thing earlier in the season. Neelix beginning to have doubts about wether or not he would feel at home on Earth somewhere halfway during the season. And ofcourse, one or two eps dealing with Voyager actually being back.