Eye of the World is rough in a lot of ways, and introduces way too many characters and settings too fast. I can understand not liking it.
But if you don't like the second book than yes, the series is not for you. Outside a few isolated moments in later books("Asha'man rolling ring of earth and fire!") I would say books 2, 3, 4, and maybe 5 are the consistently best part of the series.