> However, the lives lost in autonomous accidents will be a different set of people than those that would have died in human driven accidents.

This is a really good point. I drive really conservatively and like to think I will never ever cause an accident let alone a fatal one. I think if this lever was taken away I would have a hard time accepting the automated driving a significant amount of time.