I thought Janeway/Seven was the most popular couple on the show?
Yes, this is absolutely true.
Trek casts always leaned testosterone heavy. Replaced cast members were always same gender. The only exception might be Wesley/Ro, but she wasn't regular cast. I don't think Voyager would have changed the balance if Harry had left. They might not have replaced him at all, as they could have slid Neelix into the position.
I would have loved an all female crew.. but it's easy to just ignore people like Harry and Tom and pretend you have one anyway.