Outside of Europe, most cars are automatic/semi-automatic/manumatic, but many high-end cars (of many formats) in Europe are now semi-automatic/manumatic. Manual gearboxes won't be going anywhere for a while here, no, but things are still heading in that direction.
I resist such technologies because they do not benefit me. Call me selfish, but hey, at least I'm smart enough to drive safely without an electronic nanny doing it for me, unlike the target market of the autonomous car.
And there are enough people out there like you that the auto-driver feature is likely to be either optional (cost extra) or overrideable for people who don't want to be driven around by a robot, or want to be able to drive by hand if they feel like it.
More likely, if you ever have to worry about not having access to a manually driven car, it'll be because you're such a decrepit old geezer that your great grandchildren don't trust you behind the wheel of anything faster than a rascal.