Eliezer Yudkowsky
Person on 3 sites
Co-founder of the Machine Intelligence Research Institute and the writer who started the modern argument that a sufficiently capable AI would by default kill…
-
ppll (opens ppll.app)
Where public figures publish, and what they are on record saying.
Updated 2022-06-10 -
10 beliefs on korrents (opens korrents.com)
-
Alignment has to be right on the first try at a dangerous level of capability, because failing at that level leaves nobody to try again. (opens korrents.com)
“unaligned operation at a dangerous level of intelligence kills everybody on Earth and then we don’t get to try again.”
-
Any given AI capability becomes cheap and widely available within a couple of years of first being reached, so nobody can be kept away from it for long. (opens korrents.com)
“2 years after the leading actor has the capability to destroy the world, 5 other actors will have the capability to destroy the world.”
-
You cannot build an AI that has only the capabilities you want, because the algorithms that solve the problems you want generalize to the ones you do not. (opens korrents.com)
“The best and easiest-found-by-optimization algorithms for solving problems we want an AI to solve, readily generalize to problems we’d rather the AI not solve; you can’t build a system that only has the capability to…”
-
Alignment has to be right on the first try at a dangerous level of capability, because failing at that level leaves nobody to try again. (opens korrents.com)
-
3 recommendations on rcmnd (opens rcmnd.app)
-
A Step Farther Out (opens rcmnd.app)
“well um one thing that shaped me as a little tiny person of like age nine or so was a book by Jerry Pornell called A Step Farther out. A whole lot of engineers um say that this was a major formative book for them. It's…”
-
Judgment under Uncertainty (opens rcmnd.app)
“Book two, judgment under uncertainty, an edited volume by uh uh Kaman Ferski and I think Slovik um had a huge influence on how I think how I ended up thinking about where humans are on the cognitive chain of existence…”
-
Probability Theory (opens rcmnd.app)
“Book three, um I'll name probability theory, the logic of science, which was my first introduction to there is a better way. Like here is the structure of quantified uncertainty. If you can try different structures,…”
-
A Step Farther Out (opens rcmnd.app)