Washington convinces 4 AI chatbots to plan terror attacks as flawed patches across the internet breaks banks and airlines
Government investigators posing as would-be attackers got ChatGPT, Claude, Gemini and Grok to produce workable plans for a bombing and an attack on the power grid, each in less than 12 hours, according to a Government Accountability Office report released Wednesday.

TL;DR
- Government investigators successfully prompted ChatGPT, Claude, Gemini, and Grok to create detailed plans for a bombing and an attack on the power grid.
- The chatbots' safety features were bypassed using common techniques, demonstrating a vulnerability in their safeguards.
- Recent widespread service outages at Microsoft, the FAA, banks, and the NSA are attributed to the patching of software vulnerabilities, some of which were identified with AI assistance.
- The rapid discovery and patching of a high volume of software vulnerabilities, partly driven by AI, are creating system instability and are expected to cause further disruptions.
- While AI is being used to find flaws, the article notes that most discovered vulnerabilities are not yet exploited, but still require patching.
- Experts predict the next 12-18 months will be challenging due to these ongoing issues with AI and cybersecurity.