Certainly, they have a special bond--but is that bond sufficient that it dictates what they do with the rest of their lives (or at least the nearer part of them), or more of the type that makes them want to keep in touch and maybe hold reunions (like the one in Endgame) while they're generally off doing their own thing? (Endgame doesn't really speak to it one way or another: clearly the crew were off doing their seperate things, but it's a matter of interpretation whether being on the ship together for 30-odd years would create a closer sense of community, or make them that much more eager to get spread out and find new pastures when they finally have the opportunity to do so.)
The reason you couldn't have the whole lot of them back on a starship doing the same ol' is that, for a number of them, that was never their life's goal. The unchanging crews of the Enterprise were all career Starfleet officers when they first met and established their respective cliques--maintaining it involved little sacrifice because they were all doing what they wanted to do in the first place. For the Voyager crew, however, those were circumstances they were forced into, not chosen as a vocation. Janeway and Kim I definately see as Starfleet 'lifers'; Tuvok as well, to a lesser extent. Chakotay is less clear; he did choose Starfleet, but also chose to leave, disillusioned. Paris never really cared for Starfleet--he mainly joined because of family pressure, and even after seven years back in the service his loyalty is to people, not institutions. Torres... despite having gone to the Academy and eventually meshing with the Voyager crew, I can't imagine her staying with the service given a choice. And the Doctor and Seven, by their unique natures and personal goals, have other things to do than to go back to being crewpeople aboard a starship. Of the eight main cast who came back, I'd say half if not more wouldn't simply 're-enlist' and ship out again. (Of the measly amount of secondary cast, however, I could see Barclay and Icheb, once he graduates, being part of a 'leftover' Voyager crew.)
I think it can be generally agreed that the Enterprise crew(s) staying together was never realistic, that it was a conceit like the Enterprise always being the only ship available to solve this week's dilemna, but it was a conceit I had no real problem accepting because it maintained the series coherence. With the Voyager crew, however, it's a conceit that I couldn't accept, because more than fudging with the setting, it just wouldn't be true to the characters.
Fictitiously yours, Trent Roman