That man was creepy and everything about him lit up my spider-sense. Not a fan of that character, I wouldn't even trust him around my brother.
As an ASD individual (like Barclay probably is), I can tell you that that is very typical. Often, it feels like we live in a world that simply wishes we weren't there.
And as for his holodeck sims, can you honestly say that you've never had a fantasy that you'd be ashamed and humiliated if anyone found out about it?