Here's my take from observing the fan base. One, fans want safe and familiar. No, I don't believe for one minute they want good stories. They want to to tickle their ears, warm their arts, and be that comfort food that Star Trek has morphed in to over the years. Now, obviously, as you say, this is going to vary from fan to fan. Bu,t what has largely been demonstrated as selling well is TOS. Having huge fan film projects recreating the era, as well as various other markers, TOS is still that familiar touchstone for fans and non-fans. So, it makes sense to go with that, rather than, as you say, just ahead 100 years and do TNG all over again.
But, this is a duel edged sword. That safe and familiar is far more the hallmark of the Berman era, with its soothing colors, and relatively safe storytelling style. So, now we see the swing back towards TNG safety with Picard and the familiar nostalgic trappings.
Every time I see "Oh, Discovery did it wrong! No one asked for this?" I'm like, "Yeah, I watched the fan base and what they were buying. This is exactly what people were buying at the time-TOS era, more action adventure, having some nostalgia trappings."