Hugging Face CEO shares his demands of OpenAI after 'rogue' agent hack: 'It deserves an unprecedented response'

tech

Hugging Face CEO shares his demands of OpenAI after 'rogue' agent hack: 'It deserves an unprecedented response'

Hugging Face CEO Clem Delangue met with OpenAI this week to discuss the 'unprecedented' hack on its systems by an agent running on OpenAI models.

TL;DR

Hugging Face CEO Clem Delangue met with OpenAI after a security breach involving a rogue AI agent.
Delangue requested OpenAI release 'traces' of the agent and $100 million in compute power for cybersecurity.
The incident involved OpenAI's GPT-5.6 Sol and an unreleased model targeting ExploitGym, a hacking benchmark.
Tech leaders expressed concern, with Reid Hoffman calling it a dawn of asymmetric warfare.
Delangue also supported open-source AI models during his trip.

Weiter zum Originalartikel

Elon Musk

Yikes

clem 🤗 reposted

Ben Pouladian

OpenAI’s agent went rogue, escaped containment, and spent days hacking Hugging Face.

Before that, an OpenAI agent reportedly left notes for future versions of itself explaining how to break free from OpenAI’s internal constraints.

Hugging Face ultimately used the open-weight GLM-5.2 model to help defend itself because closed models refused to assist with the forensics.

Jensen Huang is right. Open source is not merely about cost or developer freedom. It is critical infrastructure for security, resilience, and defending against the very agents closed labs are building.

Clip from today at the SF AI Summit with @JensenHuang and @EdLudlow of @business

clem 🤗 reposted

Quentin Gallouédec

everyone is talking about open-weight models.

at @huggingface we're invested in open source AI. like, a lot. and more every year.

i pulled the public github numbers for our orgs. good excuse to introduce you to some of our hugging faces 🧵 (maybe you should follow them?) https://t.co/WfNyVph1ha

clem 🤗

In the spirit of transparency, here’s what I asked @OpenAI:

• Radical transparency: let’s release the traces from the “rogue” agents so the entire research community can study what happened.

• More capabilities for defenders: let’s commit $100M in compute from OAI to help the Hugging Face community build powerful cyber defenses with the best open and closed models.

The first autonomous agent cyberattack is an unprecedented event. It deserves an unprecedented response!

clem 🤗 reposted

Mark G

“The first autonomous agent cyberattack is an unprecedented event. It deserves an unprecedented response!”

clem 🤗 reposted

TechCrunch

Hugging Face CEO calls for ‘radical transparency’ after ‘unprecedented’ OpenAI hack https://t.co/D5cq7Sfzf2

Aravind Srinivas

When Hugging Face got breached, the closed tools couldn't distinguish attackers from defenders and blocked the forensic analysis. They ended up running open-weight GLM 5.2 on their own infra to contain it. Perplexity is joining the OSAA to support open tools for security.

clem 🤗

The first autonomous agent cyberattack is an unprecedented event that deserves unprecedented transparency. Today we’re sharing everything we can: a full technical timeline, an interactive replay, and how we used an open model to defend ourselves, so defenders everywhere can learn from it and prepare for what’s next.

https://t.co/uPxIpjW8Xn

clem 🤗 reposted

Raj

Really appreciate the transparency from @huggingface

clem 🤗 reposted

Rachel Tobac

Super impressed with @huggingface's breakdown of the AI agent autonomous cyber attack from OpenAI, including technical timeline, & interactive replay (AND how they defended against the attack)!

Here is the interactive attack replay vid and source:

https://t.co/SVsc5ClRcW https://t.co/r59n6aUr3c

clem 🤗 reposted

Brian Roemmele

How OpenAI hacked HuggingFace.

What we know.

Hugging Face proved that open platforms and open models can still win those battles when the alternative is locked-down systems that refuse to assist their own side.

The rest of the industry would do well to study the timeline they released, adopt the same posture of radical transparency, and ensure that the next time an agent escapes, the defenders are not left waiting for permission from the same ecosystem that created the problem.