Its the leola root.
You may have put your finger on something there. I bet leola root was the saltpeter of the Delta Quadrant. No wonder Neelix was so keen to put it in everything.
This explains why there were no children on Voyager. Leola root makes men impotent.