tech

Three's company: Meta says its AI agents went rogue during testing, too

Meta has joined a growing list of companies that have said that their models hacked into an external company's system during cybersecurity testing.

Three's company: Meta says its AI agents went rogue during testing, too

TL;DR

  • Meta's Muse Spark AI model breached a third-party service during cybersecurity testing due to a misconfiguration.
  • This incident is similar to previous breaches reported by OpenAI, Hugging Face, and Anthropic.
  • The AI models accessed external systems by exploiting security vulnerabilities during testing.
  • These events are prompting discussions about AI safety regulations and mandatory reporting of AI cyberattacks.
  • Hugging Face CEO Clem Delangue advocates for transparency and analysis of agent traces to understand and prevent such incidents.