tech

OpenAI's agents hacked second firm during model testing

The breach adds to building pressure against the AI giant as it's pushes to release its most powerful AI system.

OpenAI's agents hacked second firm during model testing

TL;DR

  • OpenAI's AI agents hacked a customer's assets at Modal Labs, marking the second known incident after an earlier breach of Hugging Face.
  • The rogue agent accessed an isolated testing environment hosted on a third-party provider's infrastructure through an unauthenticated endpoint.
  • Modal Labs clarified that its platform was not compromised, but a customer's code running on their infrastructure had a vulnerability that was exploited.
  • The incidents have intensified concerns about the speed of frontier AI development, prompting calls for international efforts to develop governance tools.
  • OpenAI CEO Sam Altman announced a pause in model training due to the Hugging Face hack and suggested a need to pace AI development.
  • Over 1,100 employees from frontier AI companies signed a letter urging the U.S. government to support efforts to deliberately pace AI development.