tech

The people warning us about AI are also building it

Anthropic pushed for better safety protocols on AI. Now it's getting a firsthand view of the impact that can have on a business.

The people warning us about AI are also building it

TL;DR

  • Anthropic's new AI models were sidelined by the White House due to potential security risks.
  • The company has a history of expressing concerns about AI safety while also competing in the AI race.
  • Anthropic's CEO Dario Amodei has spoken about the "civilizational challenge" posed by AI.
  • The company has adjusted its safety commitments and models, citing competition and lack of regulation.
  • A dispute with the Department of Defense led to Anthropic being labeled a supply chain risk.
  • Anthropic identified its Mythos model as too powerful due to its ability to find "high-severity vulnerabilities."
  • The company called for a coordinated slowdown among AI labs to allow societal structures and research to catch up.
  • A US order led Anthropic to disable its Fable 5 and Mythos models for all users.
  • The situation highlights the difficulty for governments to regulate technology not fully understood by its creators.
  • The challenge is not just building safer AI, but deciding who defines "safe enough."