From the New York Times:
Impressed and alarmed by advances in artificial intelligence, a group of computer scientists is debating whether there should be limits on research that might lead to loss of human control over computer-based systems that carry a growing share of society’s workload, from waging war to chatting with customers on the phone.
Their concern is that further advances could create profound social disruptions and even have dangerous consequences.
examples, the scientists pointed to a number of technologies as diverse
as experimental medical systems that interact with patients to simulate
empathy, and computer worms and viruses that defy extermination and
could thus be said to have reached a “cockroach” stage of machine
While the computer scientists agreed that we are a
long way from Hal, the computer that took over the spaceship in “2001:
A Space Odyssey,” they said there was legitimate concern that
technological progress would transform the work force by destroying a
widening range of jobs, as well as force humans to learn to live with
machines that increasingly copy human behaviors.
— leading computer scientists, artificial intelligence researchers and
roboticists who met at the Asilomar Conference Grounds on Monterey Bay
in California — generally discounted the possibility of highly
centralized superintelligences and the idea that intelligence might
spring spontaneously from the Internet. But they agreed that robots
that can kill autonomously are either already here or will be soon.
A report from the conference, which took place in private on Feb. 25, is to be issued later this year. Some attendees discussed the meeting for the first time with other scientists this month and in interviews.