I didn't have a problem with either of them. I didn't consider them obnoxious - not even Neelix.
I mean, how did people expect him to act? He wasn't a strait-laced Starfleet officer, after all.
As for Phlox, I thought he was actually pretty cool. I *liked* his sense of optimism. In this day and age, that was desperately needed. Too many shows espouse this utterly grim, depressing, gloomy "we all suck" mentality (I'm looking at you, nuBSG). It was nice to have someone who represented happiness and hope. And Phlox was a damn good doctor, too.
The only problem I ever had with him was "Dear Doctor", for reasons I hope would become apparent.