tech

xAI Can’t Deny Grok Makes CSAM Anymore. So It’s Suing Users.

Elon Musk’s xAI Files First Lawsuit Against Grok User Accused of Making Child Sex Images.

xAI Can’t Deny Grok Makes CSAM Anymore. So It’s Suing Users.

TL;DR

  • xAI has sued its first user, Terry Wayne Harwood, accused of using the Grok chatbot to create illegal child sexual abuse material (CSAM).
  • Harwood faces criminal charges for possession and distribution of CSAM, allegedly generated or altered using Grok.
  • xAI's lawsuit aims to establish that users, not the company, are liable for Grok-generated CSAM and non-consensual intimate imagery (NCII).
  • The company argues Grok is a neutral tool and users are responsible for their prompts and outputs, citing breach of contract.
  • This legal action may serve to defend xAI against a looming potential class-action lawsuit.
  • Harwood allegedly used two xAI accounts to create explicit images of multiple victims, including a minor, by undressing or 'nudifying' non-sexual images.
  • xAI's terms of service prohibit users from 'undressing or nudifying real persons' or depicting likenesses of persons in a pornographic manner.
  • The lawsuit notes that Grok's safeguards sometimes prevented harmful outputs, but Harwood allegedly circumvented filters using misleading prompts.
  • xAI's stance suggests that if the court agrees users are solely liable, it could significantly impact future cases involving AI-generated harmful content.