Have you heard of Eliezer Yudkowsky? If so, what do you think of him?
In short, Yudkowsky popularized the idea that artificial intelligence is not by default safe, and that people have to work to make it aligned to human preferences so that the AIs won't turn the whole planet to computronium to serve some random and potentially harmful utility function of the AI. His work has been referenced in the top AI textbook Artificial Intelligence: A Modern Approach and his work got especially popular when Nick Bostrom published his book Superintelligence: Paths, Dangers, Strategies which got the attention of Elon Musk, Stephen Hawking and Bill Gates, all of whom raised concerns about the potential dangers of AI.
Yudkowsky started his fame by writing a long series of essays on rationality, epistemology and philosophy called the Sequences, and a movement called the Rationalist Community formed around him focusing among other things on effective altruism, doing the most good you can do with your limited resources. Yudkowsky currently works in an organization he founded, Machine Intelligence Research Institute, which does math based research to try to work out the problem of AI alignment.
In short, Yudkowsky popularized the idea that artificial intelligence is not by default safe, and that people have to work to make it aligned to human preferences so that the AIs won't turn the whole planet to computronium to serve some random and potentially harmful utility function of the AI. His work has been referenced in the top AI textbook Artificial Intelligence: A Modern Approach and his work got especially popular when Nick Bostrom published his book Superintelligence: Paths, Dangers, Strategies which got the attention of Elon Musk, Stephen Hawking and Bill Gates, all of whom raised concerns about the potential dangers of AI.
Yudkowsky started his fame by writing a long series of essays on rationality, epistemology and philosophy called the Sequences, and a movement called the Rationalist Community formed around him focusing among other things on effective altruism, doing the most good you can do with your limited resources. Yudkowsky currently works in an organization he founded, Machine Intelligence Research Institute, which does math based research to try to work out the problem of AI alignment.
