AI that improves itself could pose “extreme risks,” say leading AI researchers.

Recursive self-improvement is a growing concern for the AI industry, and while the researchers, which include leaders at OpenAI, Anthropic, and Microsoft, say in a new paper that automated AI research lead to an “intelligence explosion,” they note that “capabilities growth could accelerate far beyond what society can keep up with,” and that humanity “could lose control over superhuman AI systems.”