Wow, people have strong opinions about this particular episode!
I discovered this thread too late to vote, but I would say "Taste" ranks in the top ten eps in TOS.
"Taste" may suffer from restrictive budgets and some odd new forms of violence (sound pistols? Kirk single-handedly captures his captors while he is a prisoner?) but despite the alleged "clichés". (really?) we seem to miss the point that it worked. There's nothing wrong with "Taste" that wasn't wrong with the rest of TOS.
It's what was right about this ep that made it outstanding. It was a fairly bold commentary on the Cold War (with the casualty lists and disintegration machines a back-handed slap against the Vietnam War). It's amazing an allegory like that made it on the air in 1967.
Yes, the funny cardboard sets made it seems cheesy at times, but TOS remastered seemed to have reversed some of that by making the capital city more substantial in the outside images.
The already-quoted "I'm a barbarian" exchange between Kirk and Anan was one of the best of the series, hands down. Kirk's later "neat and painless" speech may now sound dated and cheesy on a level of style, but given the events of the last couple of decades, maybe it's time to acknowledge that what he had to say is still relevant today.
I'm probably in the minority in that I thoroughly enjoyed Gene Lyons' portrayal of regal and obnoxious Ambassador Fox. Granted, the use of an obnoxious Federation senior official as a plot device had been done once before in TOS (John Crawford's brilliant work as Ferris in "The Galileo Seven") but the writers and Lyons took the concept and made the Federation's diplomatic overtures look reasonable and even noble; he was there to save lives, and would take any risk to complete his mission. While Ferris simply exercised his right to berate Kirk, Fox was determined to lay everything on the line to save lives. Lyons was serious and funny, all at the same time, whereas William Schallert's Nilz Barris ("The Trouble with Tribbles") was a buffoon. I actually wished we could've seen subsequent stories featuring Fox.
As for General Order 24: the Prime Directive applies to not interfering with an alien culture. TOS alone mode it clear this directive does not exempt alien threats to Federation security. This ep made it clear: the Eminians lured the U.S.S. Valiant into an ambush 50 years before, and that Anan tried to destroy the orbiting (and not actively armed) Enterprise as it was quietly orbiting with no hostile intent. Kirk was not just threatening to nuke a planet for messing with him. He was dealing with a serious threat (with at least the loose implication that the lack of diplomatic relations with Eminiar VII and Vendikar was contributing to the loss of "thousands of lives" in this general area over the years.) In other words, Kirk laid down the law and said enough was enough. These aliens claimed to be warring, attacked two Federation starships, tried to murder an ambassador, killed one of the ambassador's aides, and were contributing to the region's instability. Even if Kirk was just bluffing (was he? I like to think he was... but we'll never know, will we?

) he was within his rights to invoke General Order 24. If Kirk and Scotty hadn't threatened to nuke in the first place, they would've been seen as a paper tiger. General Order 24, while indeed barbaric, showed their mighty starships had teeth.