I too always had the idea that the Cardassians were fundamentally a weak enemy of the Federation and were only a real threat when they could
1) Conduct operations in their own backyard like the Bajoran sector or mass large numbers of ships like in "Chain of Command"(and even the the Enterprise had no problems dealing with them).
or
2) Could find a powerful ally like the Dominion to carry their water for them.