Well, I loved the first three books (though Bran's and Arya's stuff in ASOS got really boring at some points). I liked the majority of AFFC and the parts of ADWD that were in Westeros. IMO, Theon's chapters in ADWD are some of his best writing in the entire series.
I can live with his ramblings, as long as they are somehow connected to the story he's trying to tell at the moment. I hate it when he goes on a whole page description of what's everyone wearing and eating or when he writes whole chapters where people just go from one place to another and nothing happens in them.
So in the end everything boils down to the need to get him a much better editors, someone who will tell him that releasing an unfinished book is bad.
Does this stuff start more in the later books? I'm about 600 pages into AGoT and so far haven't noticed much of the stuff you guys are complaining about.
AGOT is the tightest written book in the series so far. Not the best - that's A Storm Of Swords - but the one that has the least food, clothes and traveling descriptions.
An example (if you are 600 pages in, I think it won't spoil anything) - Catelyn goes from Winterfell to King's Landing and her entire journey there is skipped. One chapter she's in Winterfell (it's the chapter with an assassin's attack on Bran) and the next she's entering King's Landing and that's it. In later books this entire journey would have taken at least 3-4 chapters, where most of the text would be a descriptions of what's going on around her, what is she wearing, eating, what's the story behind every tree, stone and ruin on the way.