I'd rather take my chances that the Federation could protect my planet.
I think my people would regret joining the others. We'd essentially be conquered already. Even the Karemma seemed to live in fear of the Jem'Hadar.
If the Klingons remained an enemy of the Federation into the 24th century, whom would you want your Federation to build an alliance with instead: the Romulan Star Empire, Ferengi Alliance, Cardassian Union, or the Dominion?