Gotta love Tom Baker's scarf, although I really think the burgundy version from Season 18 is very underrated.
I generally prefer the less uniform looks for the Doctor, particularly with Capaldi. He doesn't have an outfit so much as he has a clothing theme-- dark colors and lines that generally emphasize his skinniness. Personally, I say the scruffier the better. His original look with the white collared shirt was a little too stuffy for him. Though his worst look was the polka-dot shirt from "Kill the Moon."
Similarly, I liked how Hartnell & Troughton were going for unobtrusive black coats.
While Colin Baker's coat is a deliberate offense to the eyes, I like the way it influences and reflects his character. No one but Colin Baker could pull off that coat. When he wears it, it's like a challenge. "Yeah, this is what I'm wearing. Wanna make something of it?!" As for the blue version, it's easier on the eyes, I suspect because blue is naturally a more tasteful color than red or yellow. (With most colors, there's a spectrum and if you go too far in a particular direction, you cross a line. Blue, while not an infallible color, at least has a wider margin of error without getting garish.)