« Robot Oppression: Unethicality of the Three Laws | Main
July 28, 2004
Why We Need Friendly AI
The latest article at “3 Laws Unsafe” is “Why We Need Friendly AI,” which explores why moral AI is important and possibly necessary. The article is an edited transcript of a talk at the 2003 Foresight Gathering by the Singularity Institute’s Research Fellow Eliezer Yudkowsky.
People have asked how we can keep Artificial Intelligences under control, or how we can integrate AIs into society. The question is not one of dominance, or even coexistence, but creation. We have intuitions for treating other humans as friends, trade partners, enemies; slaves who might rebel, or children in need of protection. We only have intuitions for dealing with minds that arrive from the factory with the exact human nature we know. We have no intuitions for creating a mind with a humane nature. It doesn’t make sense to ask whether “AIs” will be friendly or hostile. When you talk about Artificial Intelligence you have left the tiny corner of design space where humanity lives, and stepped out into a vast empty place. The question is what we will create within it.
Posted by SIAI at July 28, 2004 11:23 AM