O'Brien used to wear red too, so is it an oversight that Worf didn't say, "Hey, you should know how good it feels"? Of course not. Not every conversation must cover every little point of someone's life.
O'Brien gave Worf a compliment, Worf responded. And that's that.
"Hey, I like your haircut!"
"Uh, it's the same as the one I had seven years ago, moron."