Inside the scramble for trusted AI cops

Some third party evaluators have been attacked for having close ties to the effective altruism movement.

Inside the scramble for trusted AI cops

TL;DR

  • The AI industry is in a race to establish trusted third-party evaluators as official regulation is slow.
  • The White House favors industry self-policing, but some officials and executives are wary of existing evaluation groups' ties to top AI companies.
  • Concerns have been raised about evaluators' close connections to the effective altruism movement and the companies they would oversee.
  • Some suggest that AI companies possess the most expertise and should lead in self-regulation.
  • OpenAI has proposed a voluntary public incident reporting playbook, which includes third-party auditors for complex cases.
  • Treasury Secretary Scott Bessent sees an opportunity for safety talks with China regarding AI.