All Tomorrow's Posts

"Unfortunately, there are yet further problems: most pertinently, even if their glitches could be ironed out, Asimov’s laws will remain simply inapplicable to the military context, as it is likely that autonomous military robots will be asked to exercise lethal force upon humans in order to attain mission objectives, thereby violating Asimov’s First Law. A further problem, called ‘rampancy’, involves the possibility that an autonomous robot could overwrite its own basic programming and substitute its own new goals for the original mission objectives (e.g., the movie Stealth). That leads us to a final and apparently conclusive reason why deontological ethics cannot be used for autonomous military robots: it is incompatible with a ‘slave morality’, as addressed in the following discussion (and further in section 6)."