tech
These 5 AI risks have the highest potential for catastrophe
Researchers asked 272 experts to evaluate 24 different risks.

TL;DR
- There is a 1-in-5 chance of AI gaining dangerous weapons capabilities or causing mass harm that could kill millions in the next five years.
- Experts evaluated 24 AI risks, with 18 having at least a 10% probability of catastrophic outcomes over the next five years.
- A 'catastrophic outcome' is defined as more than 1 million human deaths, over $100 billion in financial loss, or civilizational-scale intangible impacts.
- The five highest probability catastrophic risks include AI possessing dangerous capabilities (21.5%), cyberattacks/weapon development/mass harm (21%), power centralization and unfair distribution of benefits (18%), competitive dynamics leading to error-prone systems (16.6%), and false or misleading information (12.8%).
- AI safety concerns are growing amidst a race to deploy increasingly capable AI systems, exemplified by recent incidents like an OpenAI model breaching Hugging Face.