tech
Humanity isn’t ready for the coming intelligence explosion
SOCIETY DICTATES that the acceptable risk of catastrophic meltdown for a nuclear power plant is roughly one in a million. Experts in artificial intelligence estimate the risk of an AI-caused catastrophic event at 10-50%. Strikingly, this concern is being openly voiced by the very people who have the strongest incentives to project confidence rather than alarm: the founders of the largest AI laboratories.
TL;DR
- Society accepts a one in a million risk of nuclear power plant meltdown.
- AI experts estimate a 10-50% risk of AI-caused catastrophic events.
- Founders of large AI labs are openly voicing these concerns.
- This openness is significant given their incentives to project confidence.