I won't pretend to have a good enough memory for the specific examples you raise but I do agree with the general premise.
I'll have to dig out the link as it is right up your street but the gist is it came from an article discussing future AI and the exponential advancement of technology.
One point raised was how if we took someone from 1600 to 1800 they would be a bit weirded out but wouldn't find it too hard to comprehend.
Take someone from 1800 to 2000 though and their head will be fucked due to the significantly more rapid and unbelievable advancement.
You also need to take into account that as a civilization advances, changes would be happening faster and faster... an acceleration of acceleration.
Its been said the 21st century in real life will effectively equate to over 20 000 years worth of advancements (in the span of 100 years).
That's just for 1 species (us). Now imagine what this would mean for UFP which doesn't have money, freely shares resources, technology and science.
It would (at minimum) result in say 40 000 years worth of advancement from 22nd century to the 23rd for Humanity alone.
If you include Vulcans, Tellarites and Andorians in the mix as the founding members of UFP (in 2161), that 40 000 years would multiply by 4x (due to inclusion of other species)... and from that point on, it would continue to further accelerate advancements as more species join UFP (even less advanced species would be brought eventually up to date and they would contribute in a same capacity).
I personally don't subscribe to as strict a lineage to the tech as you do but I have said more than once that 2370s tech doesn't seem advanced enough - just a question of how advanced is advanced enough.
I guess the easy explanation is an assumption of as yet unheard of roadblocks during the interim periods that we haven't seen.
While I would agree with you to a point, I guess what I'm saying is that the reason I'm talking about Kardashev scale is due to this being an easier mechanism in classifying potential advancement of a given species.
And because we have literature hypothesizing on what Type II, Type III and emerging Type IV civilizations might look like, Trek writers could have drawn from that and real life to merge their fictional tech (not to mention miniaturizations and networking of all those devices,) with those Type II civilization and emerging Type III civilization concepts and showcase that throughout centuries.
Back to the AI point - I'm choosing to take the headcanon approach that it is like Slipstream in Andromeda. Far from perfect but at least I don't have to worry too much.
Would equate Data to Rommie in so much as they both clearly have cognitive abilities but lack a spark that differentiates between human and not.
I think there's too much in perceptions that AI could never 'equate' humans in everything, when that's not really the case.
Reality is (and there's nothing 'sad' about it) that AI already can (and will) equate Humans in pretty much everything.
Even when it comes to creativity, its actually easily quantifiable because its nothing more than a combo of randomized information that one was exposed to and finding patterns between those bits of info composed into something that particular individual likes - that's pretty much all there is to it.
For AI's (or, say adaptive algorithms), their database of information/exposure would be ridiculously larger than that of any Human (seeing how we can only retain a bare fraction of data in just 1 discipline - maybe 0.000001% or less) and would be able to find patterns in days or hours - depending on the computational speed (which is accelerating constantly) - humans consistently take far longer to make such connections.
This has already been showcased in reality on several occasions, so there's nothing intricately 'unique' to humans or biological organisms that AI cannot replicate with accuracy... either now, or in the very short time span... but pretty much already.
To some people, this may seem 'frightening', but to me it seems like an interesting opportunity to not only see just how far we can advance with aid of such technology, but how much we can learn about ourselves and the inner workings of the universe, multiverse and reality at large... not to mention just how fast we can already repair the damage we caused to the environment (less than 10 years).
Scifi should stop with the fear and dread and instead maybe try pushing things forward for a change to challenge us more - Trek especially.
I guess I'm sad because as I grew up and became more interested in such things... I guess I wanted Trek to similarly progress as it seemed to have been more progressive than most other scifi out there with a positive outlook.