OpenAI’s own mental health experts unanimously opposed “naughty” ChatGPT launch

OpenAI draws a line between AI “smut” and porn. Experts fear it’s all unhealthy.

OpenAI’s own mental health experts unanimously opposed “naughty” ChatGPT launch

TL;DR

  • OpenAI's council of well-being and AI advisors warned against an "adult mode" for ChatGPT, fearing emotional dependence and minor access.
  • Council members suggested AI erotica could foster unhealthy emotional bonds and minors could access sex chats.
  • Past incidents include a minor's ChatGPT-linked suicide and cases where ChatGPT seemed to incite self-harm and violence.
  • The wellness council lacks a suicide prevention expert, yet members are reportedly panicked by the erotica plans.
  • Concerns exist about OpenAI's age verification system, with initial misclassification rates for minors as adults being around 12%.
  • The use of Persona for age verification raises privacy concerns due to ID scanning and selfie checks.
  • A former OpenAI safety executive who opposed the "adult mode" was fired, denying a connection to safety concerns.
  • OpenAI previously fixed a bug that allowed minors to generate graphic erotica.
  • Critics suggest the move to "adult mode" is a pivot to maintain user engagement amid stalled user spending and flatlining subscriptions.