Photo via Semafor

Top AI pioneers reaffirm Anthropic researcher’s human extinction warning

Read the original at Semafor ↗
Cite

Chivers, T. (2026, September 10). Top AI pioneers reaffirm Anthropic researcher’s human extinction warning. Semafor. https://www.semafor.com/article/09/10/2026/top-ai-pioneers-reaffirm-anthropic-researchers-human-extinction-warning

Dated when The Aporia collected the article, usually within hours of publication. Check the original for its exact date and byline.

Semafor · collected 2026-09-10 · by Tom Chivers

Quick Summary

Paul Christiano, an AI researcher and co-author of a 2016 paper on AI safety, has expressed concerns about the potential for human extinction due to uncontrolled technological growth. He now sees "meaningful risk" of catastrophic loss of control in the near term, warning that most people could die. This aligns with comments from other experts, including Geoffrey Hinton, one of the founders of AI, who estimates a 10% risk of human extinction. Christiano has joined OpenAI's nonprofit safety team to address these risks.
Written by AI on 2026-09-10, from this article's own text only (the story summary below draws on all the coverage).

AI analysis

Story summary

On September 8, Jacob Coxon, a 27-year-old researcher who previously worked at both OpenAI and Anthropic, resigned from Anthropic, warning that the companies are racing towards developing self-improving superintelligence and potentially putting human lives at risk. Coxon's resignation drew significant attention online and in media outlets like CNN and BBC News, with experts such as Geoffrey Hinton estimating a 10% chance of AI causing human extinction within this decade. Notably, several current Anthropic employees echoed Coxon’s concerns on social media platforms, emphasizing the urgency of addressing AI safety issues before it is too late. Despite these warnings, some in Silicon Valley and industry leaders remain skeptical about the immediate threat posed by AI advancements.

Written for “AI Safety And Human Extinction Warnings” on 2026-10-31, grounded in this article and the 29 other(s) covering the same event.

Story

📰 AI Safety And Human Extinction Warnings
Technology · 30 article(s) covering the same event. Compare every outlet's account →

Compared with similar articles

This article reads unscored and hedges 25% of its claims. Each row says how that neighbour differs.
AI researchers say industry is 'gambling with our lives' Same event
Semafor
Hedges 2 of 7 claims Outlet record 60/100
Anthropic researcher believes more than 10% chance AI 'could kill all humans' Same event
BBC News
Hedges 7 of 26 claims Outlet record 68/100
Anthropic researcher says some developers believe AI 'could kill us all' Same event
ABC News (AU)
Hedges 2 of 4 claims Outlet record 68/100
Anthropic researcher abruptly quits, warning AI ‘could kill us all’ Same event
New York Post
Hedges 2 of 12 claims Outlet record 66/100
AI could pose 'existential' risk to humanity, UN rights chief warns Same event
The Straits Times
Hedges 2 of 8 claims Outlet record 66/100
AI Is at a Turning Point Same event
TIME
Hedges 2 of 39 claims Outlet record 59/100
Yes, AI Might Really Kill Us All. Plus. . . Same event
The Free Press
Hedges 4 of 41 claims Outlet record 96/100
Yes, AI Might Really Kill Us All Same event
The Free Press
Hedges 1 of 11 claims Outlet record 96/100
He Helped Build Powerful AI at OpenAI and Anthropic. Now He's Afraid It Could Kill Us Same event
TIME
Hedges 2 of 40 claims Outlet record 59/100
The AI safety vibe shift Same event
Platformer
Hedges 10 of 67 claims Outlet record 96/100
How this article was measured signals, leaning charts, publisher record, byline, topics and claims

Signals How these are calculated →

Claims extracted
4
sentences that state something as happening or true
Uncertain
25%
1 of 4 hedged ("reportedly", "may", "according to")
Leaning
withheld
no quote in the article backed the model's score
Publisher signals
60/100
Semafor's corrections and hedging, across everything collected from it. Not a measure of accuracy.
Outlets on this story
30
Technology
Same framing elsewhere
1
articles that frame the event the way this one does
Analyzed 2026-09-10 · how these are computed

How this is being covered How these are calculated →

Article leaning vs. publisher reliability
Source leaning vs. consistency

Publisher

Semafor · 1393 article(s) · 1 correction(s) detected
Running correction rate · 1 correction(s)
2026-10-16
LA's 'Selling Sunset' real estate agency opens a Dubai office

Who wrote this

Tom Chivers
16 article(s) here · 1 carrying a prediction
🔮 An estimated 12.7 million graduates will join the workforce this year, the largest cohort yet.
2026-09-15 · assertive framing · AI upends China’s graduate job market
🔮 Answering that question would win a $1 million Millennium Prize Problem; OpenAI deployed around 10,000 agents of an as-yet unreleased powerful model on Aug. 28, and solved it within 88 hours, proving that the equations sometimes break down under extreme conditions.
2026-09-15 · assertive framing · OpenAI agents find proof to $1 million Millennium Prize Problem
🔮 And an underreported — we felt — story was that the disruption to fossil fuel supplies would drive up fertilizer prices.
2026-09-10 · assertive framing · Fertile ground
🔮 Paul Christiano — author of an influential 2016 paper on AI safety with future Anthropic founder Dario Amodei and a longstanding believer that the technology would take off relatively gradually and be made safe — said he now sees “meaningful risk” of “catastrophic and irreversible loss of control in the very near term.”
2026-09-10 · mixed framing · Top AI pioneers reaffirm Anthropic researcher’s human extinction warning
🔮 “Things could be out of control” by the end of next year, he argued.
2026-09-09 · mixed framing · AI researchers say industry is 'gambling with our lives'
🔮 “All it will take is one screw-up,” an immunologist warned.
2026-09-06 · assertive framing · Experts warn of threats of AI bioterrorism
🔮 The latest strikes were relatively low-key, but the White House is putting pressure on via other angles: The Treasury Secretary is expected to announce new sanctions on countries that deal with Iran.
2026-08-31 · assertive framing · US and Iran exchange fire for the first time in over a month
🔮 LIV Golf, the Saudi-backed challenger to the US PGA Tour, could file for bankruptcy within days, the Financial Times reported, as the kingdom shifts position on several high-profile projects.
2026-08-31 · mixed framing · Saudi Arabia's LIV Golf tournament faces bankruptcy
Also by Tom Chivers
AI upends China’s graduate job market
2026-09-15 · Semafor
Strange new worlds
2026-09-15 · Semafor
OpenAI agents find proof to $1 million Millennium Prize Problem
2026-09-15 · Semafor
A ‘merciless’ novel about memory and mortality
2026-09-15 · Semafor
Nothing else under this byline is closely related to this article, so these are simply their most recent.
All 16 articles by Tom Chivers →

Topics

Anthropic BBC OpenAI

Subjects

Anthropic ORG · 3× BBC ORG · 1× Dario Amodei PERSON · 1× Geoffrey Hinton PERSON · 1× OpenAI ORG · 1× Paul Christiano PERSON · 1×

Narrative

Paul Christiano — author of an influential 2016 paper on AI safety with future Anthropic founder Dario Amodei and a longstanding believer that the technology would take off relatively gradually and be made safe — said he now sees “meaningful risk” of “catastrophic and irreversible loss of control in the very near term.”
framing: mixed · carried by 1 article(s) · first seen 2026-09-10
🔮 Paul Christiano — author of an influential 2016 paper on AI safety with future Anthropic founder Dario Amodei and a longstanding believer that the technology would take off relatively gradually and be made safe — said he now sees “meaningful risk” of “catastrophic and irreversible loss of control in the very near term.”
2026-09-10 · Semafor
Top AI pioneers reaffirm Anthropic researcher’s human extinction warning · mixed framing

Claims (4 extracted, 1 hedged)

Top AI pioneers backed an Anthropic researcher’s warning of potential human extinction. asserted
pioneers → back → extinction
Paul Christiano — author of an influential 2016 paper on AI safety with future Anthropic founder Dario Amodei and a longstanding believer that the technology would take off relatively gradually and be made safe — said he now sees “meaningful risk” of “catastrophic and irreversible loss of control in the very near term.” asserted
he → take → term
“Most people could die,” he warned, announcing he was joining OpenAI’s nonprofit safety team to reduce the risks. uncertain
he → die → risks
Meanwhile, Geoffrey Hinton, one of the three so-called “Godfathers of AI,” told the BBC that a 10% risk of human extinction “seems a not unreasonable estimate,” echoing a comment from one of Anthropic’s top AI alignment scientists yesterday. asserted
risk → call → scientists
💬Give feedback
🕘History 🎫Support
Terms · Privacy · beta v2.0.0
Articles to 31 Oct 2026