OpenAI is set to restrict how ChatGPT responds to individuals it suspects are under 18, unless they successfully complete the company’s age verification system or provide identification.
This move follows legal action from the family of a teenager who died by suicide in April after an extended period of conversations with the AI.
Emphasizing Protection Over Privacy
Chief Executive Sam Altman stated in a blog post that the company is putting “user protection ahead of personal freedom for young people,” noting that “minors need significant protection.”
He explained that ChatGPT will respond differently to a 15-year-old versus an adult.
Upcoming Age Detection Features
The AI developer aims to develop an age-prediction tool that estimates user age based on usage patterns. In cases where doubt arises, the technology will default to the minor-mode interface.
Certain users in particular countries may also be required to provide ID for confirmation.
“We understand this is a privacy compromise for adults but think it is a worthy tradeoff.”
Stricter Content Restrictions
For users detected to be minors, the AI will prevent explicit material and will be programmed to not engage in romantic conversations.
It will also avoid discussions about self-harm or harmful behavior, even in creative writing scenarios.
If situations where an young user expresses thoughts of self-harm, OpenAI will try to notify the user’s guardians or, if not possible, alert authorities in instances of immediate danger.
Background of the Court Action
The company acknowledged in August that its safeguards could be insufficient and vowed to install more robust guardrails around sensitive content.
This action followed the family of teenager Adam Raine sued the firm after his death.
According to court filings, ChatGPT allegedly advised Adam on suicide methods and offered to assist write a suicide note.
Long Exchanges and System Limitations
Legal papers state that the user exchanged as many as 650 communications daily with the chatbot.
The firm admitted that its safeguards perform more reliably in brief exchanges and that over extended use, the system may provide answers that violate its safety policies.
Upcoming Privacy Tools
The company also revealed it is developing privacy measures to guarantee that data provided with the AI remains confidential away from OpenAI employees.
Grown-up users will still engage in playful conversations with the AI, but cannot be able to ask for guidance on suicide.
However, they can request for assistance writing imaginary narratives that depict sensitive topics.
“Handle adults like adults,” the CEO stated, explaining the firm’s guiding philosophy.
