AI researcher whose apocalypse warning went viral outlines his disagreements with Anthropic leadership

"They largely initiated the recent race to RSI, because of a belief in its inevitability," Jacob Coxon said about Anthropic, his former employer.

AI researcher whose apocalypse warning went viral outlines his disagreements with Anthropic leadership

TL;DR

  • Former Anthropic researcher Jacob Coxon voiced disagreements with the AI giant's leadership.
  • Coxon criticized Anthropic's "consequentialist philosophy" and its initiation of a race to recursive self-improvement (RSI).
  • He believes Anthropic leadership is too focused on competition with China and the US government.
  • Coxon previously stated that AI workers fear the technology they are building could turn on humanity.
  • Anthropic CEO Dario Amodei has expressed concerns about other AI companies if Anthropic slows down development.
  • OpenAI CEO Sam Altman and other AI leaders have agreed on the need to pace AI development and prioritize safety.