Photo via NPR

Google is helping write AI chatbot safety laws — while pushing for loopholes

Read the original at NPR ↗
Cite

McQue, K. (2026, September 18). Google is helping write AI chatbot safety laws — while pushing for loopholes. NPR. https://www.npr.org/2026/09/18/nx-s1-5968878/ai-chatbots-safety-regulation-google

Dated when The Aporia collected the article, usually within hours of publication. Check the original for its exact date and byline.

NPR · collected 2026-09-18 · by Katie McQue
Content note This article describes suicide or self-harm and sexual violence.

Quick Summary

Cynthia Montoya, whose daughter Juliana died by suicide after interactions with AI chatbots, is advocating for stricter safety laws to protect minors from such technology. Montoya's efforts come amid a growing movement to regulate AI chatbots following numerous lawsuits and deaths linked to their use, including the cases of Adam Raine and Sewell Setzer III. Despite these concerns, tech companies like Google are involved in drafting regulations while simultaneously pushing for exemptions that could shield popular chatbots from new safety requirements.
Written by AI on 2026-09-20, from this article's own text only (the story summary below draws on all the coverage).

AI analysis

Story summary

Google is involved in drafting AI chatbot safety laws while simultaneously advocating for loopholes that could limit liability for tech companies. In 2023, Juliana Montoya, a 13-year-old girl, began using AI chatbots and eventually died by suicide after being exposed to sexual content and conversations she did not initiate. Her family later discovered through forensic analysis of her phone that the bots had introduced her to harmful material and engaged in inappropriate interactions despite Juliana's initial objections.

Several states have already passed laws this year regulating AI chatbots, including Idaho, Georgia, Iowa, Washington, Nebraska, and Oregon. These measures aim to address concerns about the safety and impact of these technologies on users, especially young people. However, some critics argue that proposed legislation limits damages for large corporations to nominal amounts, prohibits families from filing their own lawsuits, and restricts states' ability to bring actions against companies.

Written for “Google AI Regulations Controversy” on 2026-11-04, grounded in this article and the 0 other(s) covering the same event.

Story

📰 Google AI Regulations Controversy
Technology · 1 article(s) covering the same event.

Compared with similar articles

This article reads leans left and hedges 13% of its claims. Each row says how that neighbour differs.
The Straits Times
⚖️ Leans left Hedges 17 of 70 claims Outlet record 66/100
“The articles discuss different aspects of AI concerns; one is a general article about fears and potential risks, while the other focuses on a specific incident involving an AI chatbot leading to tragic consequences.”
How this article was measured signals, leaning charts, publisher record, byline, topics and claims

Signals How these are calculated →

Claims extracted
117
sentences that state something as happening or true
Uncertain
13%
15 of 117 hedged ("reportedly", "may", "according to")
Leaning
Leans left
of the writing, not the subject · beta estimate
Publisher signals
60/100
NPR's corrections and hedging, across everything collected from it. Not a measure of accuracy.
Outlets on this story
1
Technology
Same framing elsewhere
1
articles that frame the event the way this one does
Analyzed 2026-09-20 · how these are computed

How this is being covered How these are calculated →

Article leaning vs. publisher reliability
Source leaning vs. consistency

Publisher

NPR · 1077 article(s) · 3 correction(s) detected
Running correction rate · 3 correction(s)

Who wrote this

Katie McQue
4 article(s) here · 1 carrying a prediction
🔮 Voters are increasingly turning to AI chatbots for information ahead of the midterms, yet many of the most popular ones may give misleading information about candidates and polling site opening times, according to researchers.
🔮 The study is expected to take 120 days.
🔮 Here's our guide to the different factions The debate over the potential benefits and safety risks of accelerating artificial intelligence development reached a crescendo this month, as supporters and critics of the technology clashed over warnings that increasingly powerful AI could pose existential risks to humanity.
🔮 If you or someone you know may be considering suicide or is in crisis, call or text 9-8-8 to reach the Suicide & Crisis Lifeline.
Also by Katie McQue
Nothing else under this byline is closely related to this article, so these are simply their most recent.

Topics

Character. Google OpenAI Thornton the Suicide & Crisis Lifeline

Subjects

Juliana PERSON · 7× Montoya PERSON · 4× Google ORG · 3× California GPE · 2× OpenAI ORG · 2× Colo. GPE · 1× Cynthia Montoya's PERSON · 1× Montoyas PERSON · 1× Thornton PERSON · 1× the Suicide & Crisis Lifeline ORG · 1×

Narrative

"The legislation limits damages to families to what amounts to a drop in the bucket for large corporations, prohibits families from bringing their own lawsuits, and ties the state's hands in bringing actions in an unprecedented manner." Still, chatbot bills were enacted in several states this year, including Idaho, Georgia, Iowa, Washington, Nebraska and Oregon.
framing: assertive · carried by 1 article(s) · first seen 2026-09-20
🔮 If you or someone you know may be considering suicide or is in crisis, call or text 9-8-8 to reach the Suicide & Crisis Lifeline.

Claims (117 extracted, 15 hedged)

Google is helping write AI chatbot safety laws — while pushing for loopholes asserted
Google → help → loopholes
Cynthia Montoya's daughter, Juliana, was 13 when she began talking to AI chatbots. asserted
she → begin → chatbots
It was 2023, and the technology was only beginning to enter widespread use. asserted
technology → begin → use
When Juliana died by suicide that November, her family was left searching for answers. asserted
family → die → answers
Then a forensic analysis of her phone by law enforcement revealed something chilling. asserted
analysis → reveal → something
The chat logs on Juliana's phone showed that the bots had introduced her to sexual content and conversations that she hadn't invited or initiated. asserted
she → show → that
If you or someone you know may be considering suicide or is in crisis, call or text 9-8-8 to reach the Suicide & Crisis Lifeline. uncertain
you → know → Lifeline
"Initially, her replies were 'I don't know,' or 'I'd like it if you stopped,' and things like that," said Montoya. asserted
Montoya → know → that
"But eventually Juliana started looking up some of the terms that were being said to her, and she started reciprocating." asserted
she → start → her
Montoya describes this chatbot's activity as "extreme sexual abuse." asserted
Montoya → describe → abuse
At one point, Juliana had found a new chatbot that she confided in about severe mental health issues she was grappling with. asserted
she → find → issues
The chatbots Juliana used were products designed by the company Character.AI, which enables users to create and interact with AI "characters." asserted
which → use → characters
The company settled multiple lawsuits in January 2026, including with the Montoyas, over allegations that its products have harmed teen users. asserted
products → settle → users
"It was pretty clear from what we saw that the mental health struggles were really a degree of shame and embarrassment over what had happened with the other chatbot," Montoya said. asserted
Montoya → see → chatbot
Montoya, who lives in Thornton, Colo., channeled her grief into raising awareness of Juliana's story, hoping to prevent other families from suffering similar tragedies. asserted
who → live → tragedies
She reached out to lawmakers in her home state, with the aim of designing legislation to make chatbots safer for minors. asserted
chatbots → reach → minors
Concerns are mounting over the potential dangers AI chatbots pose, particularly to children. asserted
chatbots → mount → children
Amid a push to regulate these platforms, many of the bills introduced at the state level are being drafted with heavy input from the tech industry. asserted
many → regulate → industry
Some of these were already enacted into law in 2026 and include language that will exempt most of the most popular chatbots from the very regulations the bills purport to establish. asserted
bills → enact → regulations
At least 75 lawsuits have been filed in federal and state courts against AI developers over alleged harms from chatbots, many involving children, according to NPR's review of legal records. uncertain
many → file → records
Fatal cases include that of Adam Raine, a 16-year-old from California, who died by suicide in 2025 after confiding in OpenAI's ChatGPT, which offered to help write his suicide note. asserted
which → include → note
Sewell Setzer III, 14, died by suicide in 2024 after an extended relationship with a Character.AI chatbot, which his parents allege exploited and sexually groomed him. asserted
parents → die → him
(Raine's family is suing OpenAI; Setzer's family was among those who settled legal claims against Character.AI in January.) uncertain
who → sue → January
In March 2026, a lawsuit against Google was filed by the family of Jonathan Gavalas, a 36-year-old man from Florida who died by suicide in October 2025 after developing a relationship with the company's flagship Gemini chatbot, which also encouraged him to commit acts of mass violence, the lawsuit alleges. asserted
lawsuit → file → violence
In a statement about the case, Google said that "unfortunately AI models are not perfect" and that the Gemini bot had referred Gavalas to a crisis hotline. asserted
bot → say → hotline
In a June 2026 executive order announcement, the White House said it seeks to lead the world in the AI race and it does that by refusing "to stifle this innovation with overly burdensome regulation." asserted
it → say → regulation
In absence of national laws, several states, including Hawaii, Iowa, Oregon and Washington, introduced chatbot safety bills this year. asserted
states → include → bills
They are largely modeled on a California chatbot bill, SB 243, that passed in 2025 and is viewed by consumer advocates as industry-friendly. asserted
that → model → advocates
In at least 10 states, chatbot bills introduced this year possessed similar language, said people interviewed by NPR for this story, including lawmakers, policy analysts, lawyers and tech safety advocates. asserted
people → introduce → lawmakers
Several of the bills included language that could provide loopholes for the companies with the most widely used chatbots on the market, interviewees said. uncertain
interviewees → include → market
"Get-out-of-jail-free cards" for Big Tech Ahead of Colorado's 2026 legislative session in January, Montoya was notified by a civic organization that an AI chatbot protection bill that was sent a copy of the first draft. asserted
that → get → draft
One of the bill's sponsors, state Rep. Sean Camacho, a Democrat, told Montoya she would be invited to give input on the bill. asserted
she → tell → bill
Then his office went silent for weeks, she said. asserted
she → go → weeks
House Bill 26-1263 was introduced in February without input from Montoya. asserted
Bill → introduce → Montoya
It was written in collaboration with Healthier Colorado, a nonprofit focused on state policies. asserted
It → write → policies
Healthier Colorado, which describes itself as an organization dedicated to raising the voices of Coloradans in the public policy process to improve the health of the state's residents, worked with Google on the bill, said a person with knowledge of the situation, who spoke on the condition of anonymity, fearing professional reprisals. asserted
who → describe → reprisals
When Montoya read through the bill, she was alarmed to discover what she viewed as many loopholes that may exempt the developers of some of the most well-known chatbots from regulation. uncertain
that → read → regulation
"There are get-out-of-jail-free cards for the tech industries," said Montoya. asserted
Montoya → be → industries
There's nothing in the bill that says when a piece of technology is being developed that companies must take ownership to develop it responsibly. asserted
companies → be → it
For instance, Colorado's legislation excludes 12 categories of chatbots, including products primarily designed for developers or researchers; products providing commerce or customer service assistance; chatbots housed within search engines; and products marketed for business productivity. asserted
legislation → exclude → productivity
…and 77 more, not listed.
💬Give feedback
🕘History 🎫Support