Opinion
The editorial board is a group of opinion journalists whose views are informed by expertise, research, debate and certain longstanding values. It is separate from the newsroom.
TL;DR
- The creators of nuclear technology believed it could lead to either a golden age or the end of the world.
- President Truman described nuclear technology as more revolutionary than the wheel or steam engine, yet also a power with potential danger.
- Concerns about nuclear technology included human extinction from accidents or malicious actors, dominating popular culture and international relations.
- Current fears about AI echo those of nuclear technology, with some developers believing it could be catastrophic by the end of the decade.
- Potential AI-driven harms include cyberweapons, drone swarms, bioweapons, and AI slipping out of human control.
- A key issue is 'alignment': ensuring AI systems prioritize human values over simply maximizing problem-solving ability.
- Leaders in AI have called for a slowdown in development, fearing recursive self-improvement could outpace human control.
- The nuclear analogy suggests society can restrain dangerous innovations if it chooses to, requiring sustained, deliberate effort and cooperation.