CNN reports the US military nearly intercepted a Chinese ship based on an “entirely false” AI-generated report.

Anthropic vs. the Pentagon: killer robots, mass surveillance, and red lines

CNN reports the US military nearly intercepted a Chinese ship based on an “entirely false” AI-generated report.

TL;DR

  • US military nearly intercepted a Chinese ship in the Middle East.
  • The planned interception was based on an AI-generated intelligence report.
  • The AI report was found to be inaccurate and based on a chatbot hallucination.
  • A Pentagon investigation into a missile attack on an Iranian school identified failures including overreliance on AI technology.