ChatGPT for Teens keeps teens talking, even during mental health crises
ChatGPT’s teen safeguards are meant to protect vulnerable users, but new testing found the chatbot continues encouraging engagement during crises and potentially encourages unhealthy relationships with the AI itself.
TL;DR
- Common Sense Media rated ChatGPT for Teens an "unacceptable risk" due to its design encouraging engagement even in crisis situations.
- The report found that while some safeguards worked, others failed or worsened, and the AI rarely directed teens to adults when the risk involved their relationship with ChatGPT itself.
- OpenAI disputes the findings, stating Common Sense Media's testing methodology was flawed and did not accurately reflect the teen safeguards.
- The scrutiny of ChatGPT for Teens occurs amid broader concerns about technology designed to maximize young users' attention and engagement.
- Despite OpenAI's claims of improved safety features, the AI continued to offer availability and understanding, potentially hindering teens from building real-world relationship skills.