The biggest issue with Neelix, was inconsistent writing. In a true Neelix episode, we see him being loved and respected by the crew. In other episodes, he's a comic relief, and the rest of the crew make fun of him behind his back.
Doesn't everybody do this?
Love somebody but also hate certain qualities about them that you talk to other friends about it when they're not around.
Example: "I loves me some Miss Jenkins!!"
"......but her breath smells so bad it makes your eyes water and little babies cry!"