My take is that the Klingons equate uniforms with military service as warriors (naturally).
Therefore, Klingon uniforms feature armor and medals and ranks and honor badges and weaponry and all that. The uniform of a warrior.
Conversely, Worf's Starfleet uniform has none of that, barely rank insignia and Starfleet emblem and that's it. That's it??? And oh so colorful, like pajamas. Not the uniform of a warrior, more like a "child's uniform" (no armor, no weaponry, no medals of glory or honor).