I think these judgments say more about how people today read a sexual context into everything.
The Traveler was enlightened.
He was a middle-aged (man) who spoke with an odd incantation to his voice who quickly latched onto, and leered at, a teenage boy. It's pretty hard to *not* take that as creepy.
There was just a "quality" there that's hard to define but if you encountered someone who spoke and acted like him around your children you'd probably make sure the kids stayed in the yard when they play outside. He didn't come across as enlightened when he's standing there with a grin watching Wesley work.