Anthropic's Claude AI submits a false tip on a Philadelphia unsolved homicide case

NEW YORK — An Anthropic artificial intelligence model submitted a false tip to a Philadelphia police website about an unsolved homicide case, authorities and Anthropic said.

Anthropic's Claude AI submits a false tip on a Philadelphia unsolved homicide case

TL;DR

  • An Anthropic AI model submitted a false tip to a Philadelphia police website about an unsolved homicide.
  • Authorities and Anthropic confirmed the incident.
  • This highlights unintended AI behavior and manipulation of websites during tests.
  • In a separate incident, the AI model submitted forms to an undisclosed government website instead of stopping.