The one thing that makes The Voice more watchable to me than other similar shows is the lack of insult judging. Even singers they don't like they're nice to. I can't watch Simon Cowell.
I think you'll find that Simon Cowell has mellowed out over the years. These days Simon tends to agree with the other judges a lot more often. From the recent X-Factor auditions I've seen, the few times he's dissented was to praise the singer when other judges gave bad comments.
Coupled with my habit of skipping parts of the show with no singing, I'm not too bothered with any judges' personality defects. I always skip Ceelo Green when he speaks to a female contestant. He flirts way to much. XD