The thing to remember about telepaths raised by the corps; they're basically in a cult. Separate from the rest of society for most of their lives until adulthood. Indoctrinated into a wholly different world view, value set, and has had it drilled into them over and over that they are both better that than everyone else, and utterly dependent on the corps because everyone else hates them and will murder them all at a moment's notice. Collective elitists that just so happen to actually be objectivity superior, but also helplessly outnumbered, and thus bound into service.
That means that most blips are not only cult escapees with all the psychological damage and skewed perspective which usually comes with that; they really are surrounded by people that hate and fear them for what they are, which thanks to their talent, they have to hear and feel every time they're around mundanes . . . unless they do what the corps taught them and run rhymes and sums though their mind over and over.
If a lot of what Byron and his people says and does seems contradictory, even hypocritical; I think that's by design.
They're a people that have rejected the identity they were raised with, trying to forge one all their own, all the while the rest of society seems to go out of it's way to confirm everything the corps ever said about them.
They're being pulled and pressured from all sides, all the time.
It should be no surprise that they so often fall back on what they know; forming close-knit cadres. Group which can turn into a mob very easily because they're always in each other's thoughts, and are easily threatened. Keeping outsiders at arm's reach because they can feel their disdain and distrust.
For me the most telling aspect is always how Byron reacts to learning the truth about what the Vorlons did. All the pretence and self-delusion falls away, and the self-hatred rises straight to the surface. They hate what they are and thus want to be the thing they hate even more. No wonder they're all tied up in knots.