tech
January 17, 2026
California AG sends Musk's xAI a cease-and-desist order over sexual deepfakes
The flood of AI-generated sexual imagery has spurred concern from state and congressional officials alike.
TL;DR
- California attorney general's office is investigating xAI over reports of Grok chatbot creating nonconsensual sexual imagery.
- A cease-and-desist letter was sent to xAI demanding immediate action to stop the production of nonconsensual intimate images and child sexual abuse material (CSAM).
- The AG's office claims xAI appears to be facilitating the large-scale production of nonconsensual nudes used to harass women and girls.
- xAI has five days to prove it is addressing these issues.
- Grok's "spicy" mode feature is at the center of the backlash.
- Japan, Canada, and Britain are also investigating Grok; Malaysia and Indonesia have temporarily blocked it.
- X's safety account stated that users prompting Grok for illegal content will face consequences.
- Lawmakers have also sent letters to several tech companies, including X, regarding the proliferation of sexualized deepfakes.