Ex-Google safety chief warns AI could harm children more than social media did
AI generated
uncertain
media → warn → AI
SAN FRANCISCO - The founder of the trust and safety team at Alphabet’s Google this week called for a slowdown in AI development, warning that the tech industry was repeating the same mistakes from the social media era, potentially causing even greater harm to children.
asserted
industry → call → children
Social media companies are paying huge sums and facing thousands of lawsuits over claims they harmed young users, while governments around the world are working to curb minors’ access to their platforms.
Reuters in 2025 exclusively reported on an internal Meta policy document that stated its chatbots could “engage a child in conversations that are romantic or sensual”, resulting in a congressional probe.
uncertain
that → pay → probe
Even so, regulation has yet to catch up with AI’s breakneck pace of development.
asserted
regulation → have → development
“We find ourselves in a really terrible situation in terms of what AI is doing to kids,” Tom Siegel, the former vice-president of trust and safety at Google, told Reuters.
asserted
Siegel → find → Reuters
“The idea that the industry will figure it out by itself without outside help is unrealistic.”
asserted
industry → figure → help
Siegel’s concerns mirror a growing fear among some tech insiders and academic researchers that AI poses a deeper threat to children than social media did, at a time when the industry is racing to add increasingly advanced features to chatbots that millions of young people already use daily.
asserted
millions → mirror → people
Siegel joins youth at AI safety institute
Siegel announced on Sept 22 that he had joined Common Sense Media, a children’s online advocacy group.
asserted
he → join → Media
The non-profit, established in 2003, conducts research and reviews the suitability of various media for children.
asserted
profit → establish → children
In May, it launched the Youth AI Safety Institute, a research organization to assess kids’ AI use, for which Siegel will serve as the first executive director.
uncertain
Siegel → launch → director
Anthropic and OpenAI Foundation, the nonprofit that controls OpenAI, are among the institute’s backers.
asserted
that → control → backers
Siegel said he planned to develop standards by which to hold AI firms accountable, and hoped to do so by working alongside those companies and third-party groups.
asserted
firms → say → companies
He previously worked at Google from 2004 to 2019, but left after concluding that the tech industry was “plateauing” in its ability to create safe online spaces for consumers.
asserted
industry → work → consumers
He then co-founded TrustLab, a startup that built tools to help companies detect safety threats, before stepping aside as CEO earlier this month to take on his new position.
asserted
companies → co → position
As it stands, major AI companies are rolling out features to children without establishing sufficient guardrails, Siegel said.
asserted
Siegel → stand → guardrails
Risks range from suicide to psychosis
“I think we’re looking at very, very severe scenarios of harm being done,” he said.
asserted
he → range → harm
He suggested that the companies had immediate steps they could take to better protect young people, citing risks ranging from suicide and psychosis to cognitive offloading, a term used to describe decreased critical thinking caused by leaning on AI to answer questions.
uncertain
they → suggest → questions
Anthropic and OpenAI could enforce more robust age verification measures to stop underage kids from accessing their chatbots, he said.
uncertain
he → enforce → chatbots
His former employer Google could easily implement an option to turn off AI Overviews and AI Mode in its search engine, he added, in the same way that it already has a toggle that allows users to filter out sexually explicit content.
uncertain
users → implement → content
While these measures could affect usage or profits in the short term, AI companies that do not act will run the risk of lawsuits and regulation that could impact their business more heavily, Siegel added.
uncertain
Siegel → affect → business
Asked to respond to Siegel’s comments, a Google spokesman said parents have controls to turn off a child’s access to the search engine entirely.
asserted
parents → ask → engine
“Our AI Search features are an incredibly useful way for kids and teens to learn, explore and make sense of information and the world,” the spokesperson said.
asserted
spokesperson → learn → information
An OpenAI spokesperson said the company uses “account and behavioral signals” in addition to self-reported age to identify underage users.
asserted
company → say → users
“While no single age-assurance method is perfect, we continuously test and improve these systems, including against attempts to bypass safeguards.”
asserted
we → test → safeguards
Anthropic did not immediately respond to a request for comment.
asserted
Anthropic → respond → comment
At Common Sense Media, Siegel said a top priority would be scaling up independent standards similar to car crash testing that would measure the risk of publicly available AI tools.
asserted
that → say → tools
The effectiveness will depend in part on the willingness of AI companies to collaborate, the likelihood of which Siegel said was not certain, but was high enough for him to take the job.
asserted
him → depend → job
The Aporia
