He's desperate, he's hairy...
What the HELL does that have to do with anything?
One would assume that's being used to voice that he's conventionally not attractive, given the context of the rest of that statement.
Really Neelix should have treated Kes like a goddess instead of a quasi-possession he gets insanely jealous over. That he has a girlfriend is a proof that the galaxy is a kind place.