If they were randomly flying around, heard that the Klingons (who weren't their enemies at the time) were fighting the Cardassians and ran into a debris field and then decided not to do anything because they might get attacked (by whom? Why would either of those guys attack them?)? Yeah, I'd question them and their ethics.
Now, if there was some greater purpose in "Voyager" beyond "Running away and saving our own skins" as the central plot then I could accept them taking on the Borg if they attack a world and then having to withdraw in failure.
But there wasn't.