I respectfully disagree. What you think is unrealistic I think is aspirational. I don't see the [decrease] in conflict due to some writer's magic wand ultimately conjuring bots more than people, but instead loved educated and seasoned reasoning people trying at working together toward greater mutual gain. That takes faith and trust as much as anything, but, uh, so does banking and modern society. It's when people begin to feel the system is rigged that things deteriorate. No moonbase for us. Back to school shootings.
Gene's original idea was that humanity will overcome its shortcomings and achieve enlightenment. And that is a problem on multiple levels.
First, it is completely unrealistic. Humans have not changed, on a basic psychological level, for the last ten thousand years or so. The only reason why we aren't bashing in each other's heads on a regular basis is because a) we never did that and b) there is no need. But overall, Deep Space Nine has far more realistic assessment of human nature than anything from Gene's era:
And then Quark proceeds to prove that he is no different from humans. And that is just natural, because if you are unable to kill, you will be killed. There is no way around it.Let me tell you something about Hew-mons, Nephew. They're a wonderful, friendly people, as long as their bellies are full and their holosuites are working. But take away their creature comforts, deprive them of food, sleep, sonic showers, put their lives in jeopardy over an extended period of time and those same friendly, intelligent, wonderful people... will become as nasty and as violent as the most bloodthirsty Klingon. You don't believe me? Look at those faces. Look in their eyes.
Second, it makes for bad storytelling. Any story, to be interesting, requires conflict. But if you assume that humans can overcome their flaws, this removes one of main sources of conflict. Because all good stories had not only external conflict, but also internal conflict, one that is fought within human heart (One Ring is a good example of physical manifestation of such).
Third, preachy shows are just bad. That is why most modern movies and shows fail, because they are pushing politics and ideology onto people instead of telling stories about human beings. End result is a hollow story, flat, two-dimensional characters, and a completely uninteresting world.
Conflict comes in many forms. We don't by and large settle our disputes with duels, rape, and genocide, etc these days, yet drama persists. It's about finding it in the moment. We all feel it in our lives. An argument can be as harrowing, more so, than the umpteenth murder of a redshirt.
That is not what I'm talking about. Early TNG has as much physical conflict as any other era of Star Trek. What it lacks is the very core of Star Trek: exploration of human nature. It assumes humans will become enlightened to a rather ridiculous degree, and frankly, it lacks humanity.
Gene's idealism nearly ruined Star Trek then and there. Much like George Lucas, he had an outstanding fundamental idea, but had he been left to make decisions on his own, he would have turned that idea into something completely unwatchable and unrelatable. Both Gene and George required other people to literally hold them by hand in order to make their ideas into actual art.
Also the first two seasons of TNG were them trying to find what became Star Trek for the decades after. Watch some other sci-fi of the time and thank TNG for its service. While you're at it, I do recommend giving Strange New Worlds a try. Like every Trek series, it's different in its own way from everything else, but I think it's pretty good. I think Discovery, alas, went downhill fast toward the middle-end of its second season, though some people seem to like it still. You tell me if you do. The first season especially is brilliant for something that happens toward the end of it. Maybe consider Prodigy too – it's a charming uplifting [younger fan] show.
Maybe, but early TNG also had more problems than just finding its footing - see above.
I will give SNW a try, but considering what I have seen from modern Trek, I frankly don't expect anything but disappointment. Granted, I haven't watched that much of post-Enterprise materials (except for movies), but from what I have seen, it has been a constant downward trajectory for Star Trek ever since Deep Space Nine.