The scene in The Chute when they discover what the prison really is, is a dramatization of enlightenment about the world around us, as well as a cool visual. And the prison isn't just a cage for Paris and Kim but the prison of our limited understanding and limited roles in society.
Anyway. Yes, "episodic amnesia" is basically the hallmark of Voyager and a bigger crime in that show than in TNG or TOS given the fact it aired after those shows and had a different concept that lent itself more to serialization. But I just rate episodes by their individual merits like I would a TNG episode. However when it comes to rating the actual show itself, I obviously take a different approach and consider more than just all the individual parts but rather the whole thing.