More than 100 AI industry experts wrote a letter calling for independent evaluation of frontier models.

Academics, evaluators, and AI leaders signed a public letter calling not just for embedded third-party evaluators at top AI labs like OpenAI and Anthropic, but for conditions that allowed for transparency by those evaluators, like “limiting the scope of non-disclosure agreements.” I wrote an in-depth feature about the battle over the need for embedded evaluators this week for The Verge.

More than 100 AI industry experts wrote a letter calling for independent evaluation of frontier models.

TL;DR

  • Academics, evaluators, and AI leaders signed a public letter.
  • The letter calls for embedded third-party evaluators at top AI labs.
  • It also demands conditions allowing transparency for these evaluators, such as limiting NDAs.
  • The author wrote an in-depth feature about this issue for The Verge.