California Attorney General Rob Bonta and Delaware Attorney General Kathy Jennings have issued a sharp warning to OpenAI over the safety of ChatGPT, citing recent tragedies involving children and teens.
In an open letter sent to the company, the two AGs referenced the suicide of a young Californian and a separate murder-suicide in Connecticut, both reportedly involving prolonged interactions with an OpenAI chatbot.
“Whatever safeguards were in place did not work,” Bonta and Jennings wrote.
The letter comes just one week after Bonta and 44 other attorneys general pressed a dozen leading AI firms about reports of sexually inappropriate interactions between chatbots and minors.
The AGs are also reviewing OpenAI’s ongoing restructuring into a for-profit entity, emphasizing that its nonprofit mission must remain intact. That mission, they noted, includes ensuring AI is safe for all people, especially children.
“Before we get to benefiting, we need to ensure that adequate safety measures are in place to not harm,” the letter continued. “OpenAI and the industry at large are not where they need to be in ensuring safety in AI products’ development and deployment.”
Bonta and Jennings have requested additional details about OpenAI’s safety protocols and governance, and said they expect the company to implement immediate remedial measures.
OpenAI board chair Bret Taylor responded in a statement:
“We are heartbroken by these tragedies and our deepest sympathies are with the families. Safety is our highest priority and we’re working closely with policymakers around the world.”
Related: Parents Sue OpenAI Over Teen’s Suicide Linked to ChatGPT Use
The company added that it is working on expanded protections for teens, including parental controls and systems that notify parents when a child shows signs of acute distress.
