I happen to like the Telepath story arc, and don't find Byron to be a bad character in the least.
Again, though, 'to each their own'.
I actually didn't mind it either (I remember the first time watching B5 and people warning me about Byron and by the end of the Arc I was like, "That's it?") but it was a downgrade from what came before. Like I said, once the Centauri plot took over, things were back up to Season 4 levels, maybe slightly lower.