In my experience, it generally goes like this. You watch the pilot, and go, "Huh. That was pretty okay, I guess." A few weeks later, you're bored, so you watch "The Train Job." Again, sort of "eh." Then you watch "Bushwacked" maybe a week later. A couple days after that comes "Shindig," and then you figure, well, the disc is already in the player, so you do "Safe," too. Another day or two later, you give "Our Mrs. Reynolds" a try, and then you're hooked and watching as much as you can as quick as you can and are shaking and crying like a junkie in withdrawal by the time it's over.
So anyone who gives up on the show within the first three episodes isn't necessarily suffering from a criminal lack of taste.