You will never be able to remove the driver's responsibility.
I'm actually going to agree with this. Any automated systems should be treated like an airplane's autopilot----available as a tool, but not in any way alleviating the pilot's responsibility for the safe completion of the flight.
It may come about that someday we can take things farther than that, but we have a ways to go before we get there. In the meantime, let's just get as much driver-assist technology in place as we can.
One negative side effect of driver assistance systems is that people unlearn how to drive, basically. Rely on your parking assistance way too often and you stop being able to park your car properly in case the system fails, for example.
Also the reliance on your assistance systems makes you pay less attention, and increases your reaction times in case something goes wrong, that's been shown as well.