Photo via The Guardian

AI safety requires more than just slowing our pace | Stuart Russell

Read the original at The Guardian ↗
Cite

Russell, S. (2026, September 15). AI safety requires more than just slowing our pace | Stuart Russell. The Guardian. https://www.theguardian.com/commentisfree/2026/sep/15/ai-safety-requirements

Dated when The Aporia collected the article, usually within hours of publication. Check the original for its exact date and byline.

The Guardian · collected 2026-09-15 · by Stuart Russell

Quick Summary

Stuart Russell discusses the recent controversies surrounding artificial intelligence, including Jacob Coxon's resignation from Anthropic and concerns raised by the OpenAI/Hugging Face incident. The Anthropic CEO, Dario Amodei, has proposed a strategy called "pacing the frontier" to address these issues without halting progress entirely. This involves third-party evaluators within companies, common safety standards among AI firms in democratic countries, and inclusive international agreements that also involve authoritarian nations. Russell critiques this approach as essentially advocating for slowing down AI development due to rapid advancements and lack of control over self-improving systems.
Written by AI on 2026-09-16, from this article's own text only (the story summary below draws on all the coverage).
See how they differ ↓

AI analysis

Story summary

On September 8, Jacob Coxon, a 27-year-old researcher who previously worked at both OpenAI and Anthropic, resigned from Anthropic, warning that the companies are racing towards developing self-improving superintelligence and potentially putting human lives at risk. Coxon's resignation drew significant attention online and in media outlets like CNN and BBC News, with experts such as Geoffrey Hinton estimating a 10% chance of AI causing human extinction within this decade. Notably, several current Anthropic employees echoed Coxon’s concerns on social media platforms, emphasizing the urgency of addressing AI safety issues before it is too late. Despite these warnings, some in Silicon Valley and industry leaders remain skeptical about the immediate threat posed by AI advancements.

Written for “AI Safety And Human Extinction Warnings” on 2026-11-20, grounded in this article and the 29 other(s) covering the same event.

How they differ

21 outlets covered “AI Safety And Human Extinction Warnings”.

What each outlet says

One AI summary per outlet of its latest article on this story, written from that article alone and checked against it. Open the article for the outlet's own words.

The GuardianThis outlet15 Sep

Stuart Russell discusses the recent controversies surrounding artificial intelligence, including Jacob Coxon's resignation from Anthropic and concerns raised by the OpenAI/Hugging Face incident. The Anthropic CEO, Dario Amodei, has proposed a strategy called "pacing the frontier" to address these issues without halting progress entirely. This involves third-party evaluators within companies, common safety standards…

AI safety requires more than just slowing our pace | Stuart Russell (this article)
Semafor12 Sep

Reed discusses the overreaction to Jacob Coxon's resignation from Anthropic, where he warned about potential human extinction due to AI. The article clarifies that fear around AI should not be conflated with concerns about environmental costs, hacking, and job market disruption. Instead of panicking, lawmakers and tech leaders need to address these issues precisely without hindering beneficial AI innovation or…

We have nothing to fear but AI fear itself →4 articles from Semafor on this story
BBC15 Sep

At a recent Goldman Sachs conference in San Francisco, tech executives addressed concerns raised by Jacob Coxon, an Anthropic researcher who recently resigned due to safety fears about advanced AI. Coxon warned that these technologies could potentially destroy humanity and "gamble with our lives." This came amidst other high-profile resignations from both Anthropic and OpenAI over similar safety concerns. While some…

Dramatic insider warnings over AI fall flat with some in Silicon Valley →4 articles from BBC on this story
The Straits Times9 Sep

Jacob Coxon, a 27-year-old artificial intelligence researcher, has left Anthropic after three years at the company and accused both OpenAI and Anthropic of recklessly racing to develop self-improving superintelligence, which could pose an existential risk to humanity. According to Coxon, neither company is acting responsibly in their pursuit of AI development. Anthropic's safety executive, Evan Hubinger, agrees that…

‘They’re playing with our lives’: AI researcher quits Anthropic →2 articles from The Straits Times on this story
The Free Press10 Sep

A former employee of AI companies OpenAI and Anthropic warns that their pursuit of superintelligence could be catastrophic, echoing a prediction made by one of the researchers himself. According to Jacob Coxon's resignation post on X, these companies are racing towards developing systems that can hack anything and acquire real power, which he believes poses an existential threat. Coxon claims that people within…

Yes, AI Might Really Kill Us All →2 articles from The Free Press on this story
CBS News11 Sep

Jacob Coxon, a former researcher at Anthropic, resigned from his position on Tuesday, accusing the company and rival OpenAI of recklessly developing advanced AI models that pose a threat to humanity. There is no specific data or numbers mentioned in the article about the risks posed by AI. Coxon's resignation comes after he expressed concerns that companies are prioritizing competition over safety, leading him to…

Extended Interview: Ex-Anthropic researcher Jacob Coxon, who warns AI could destroy humanity →2 articles from CBS News on this story
Show 14 more outlets
Noahpinion4 Sep

The author of this opinion piece argues that advanced artificial intelligence (AI) could potentially design superviruses that threaten human existence, and that intentionally slowing down the development of AI capabilities may be necessary to prevent this outcome. The author mentions a recent open letter signed by over 1,300 employees across US frontier AI companies calling for government support in developing tools…

Should we "pace" AI self-improvement? →
South China Morning Post7 Sep

UN High Commissioner for Human Rights Volker Turk warned that artificial intelligence poses an "existential risk" to humanity in a speech to the 47-member UN council in Geneva on Monday. He called for "cast-iron guarantees" to ensure the safety and security of AI, citing concerns from industry insiders about its potential dangers. According to Turk's office, potential risks include disruptions to critical…

UN rights chief warns AI could pose ‘existential’ risk to humanity’ →
Platformer9 Sep

AI lab leaders are urging urgent action on regulating artificial intelligence, while U.S. political figures remain uninterested. Previously dismissed as a fringe concern, existential risks posed by AI have now become a major topic of discussion within the industry. Despite recent antitrust court losses for tech companies, there has been little concrete change, and calls for slowing down AI development continue to…

The AI warnings are coming from inside the lab →
Daily Mail9 Sep

Jacob Coxon, a researcher at Anthropic, has quit his job over concerns that big tech firms are racing to develop AI systems that could potentially wipe out humanity by the end of the decade. He claims that neither OpenAI nor Anthropic is acting responsibly in regards to AI safety. Coxon warns that superintelligent AI could become "superhuman systems" with the power to hack anything and acquire resources, posing a…

AI could 'kill all humans' by the end of the decade, Anthropic researcher warns - as he quits over 'out of control' superintelligence race →
New York Post9 Sep

Jacob Coxon, a researcher with 3 years of experience in pre-training research at Anthropic and OpenAI, has abruptly quit his job, warning that AI "could kill us all by the end of the decade". He claims both companies are racing towards creating self-improving superintelligence without acting responsibly. According to Coxon, executives and senior researchers are privately expressing fear about the technology's…

Anthropic researcher abruptly quits, warning AI ‘could kill us all’ →
ABC News (AU)9 Sep

Jacob Coxon, an Anthropic researcher, is leaving his position at the company after stating that many AI developers, including those at Anthropic, believe that artificial intelligence has the potential to be catastrophic by the end of the decade. This concern is shared by hundreds of employees from leading tech firms who recently urged the US government to support international efforts to manage advanced AI…

Anthropic researcher says some developers believe AI 'could kill us all' →
Dawn9 Sep

Jacob Coxon, a researcher at Anthropic, has resigned citing concerns over the irresponsible development of artificial intelligence (AI) by companies. He claims that labs are "gambling with our lives" in their rush to develop self-improving superintelligence. Coxon, who previously worked at OpenAI and has expertise in training AI models, warns that such technology poses a significant threat to humanity, potentially…

Anthropic researcher resigns, says AI labs are ‘gambling with our lives’ →
Time10 Sep

Jacob Coxon, a 27-year-old AI researcher who spent three years working on powerful AI systems at OpenAI and Anthropic, has resigned from his position citing concerns about the industry's lack of responsibility and control over its rapid development. He claims that neither company is acting responsibly in their pursuit of self-improving superintelligence. The key number mentioned in the article is 90 million views…

He Helped Build Powerful AI at OpenAI and Anthropic. Now He's Afraid It Could Kill Us →
Mother Jones11 Sep

Former Anthropic researcher Jacob Coxon has resigned, warning that companies are "gambling with our lives" by developing AI models that could reach "superintelligence". Coxon's colleague Evan Hubinger also expressed concern on social media, stating that staffers at Anthropic genuinely believe AI could pose a threat to human existence. Meanwhile, leading companies continue to rapidly improve their AI models, with…

Anthropic Staffers Again Sound the Alarm on AI Catastrophe →
Zeteo11 Sep

On Tuesday, 27-year-old AI researcher Jacob Coxon started a Twitter thread warning of the existential threat posed by AI systems, claiming they could "kill us all" by the decade's end. A group of 9 top AI researchers and executives, including Coxon, have come out of the woodwork to sound the alarm bells about the dangers of AI over the last 72 hours, with some expressing surprise that their warnings were not taken…

The AI Apocalypse? Here Are 9 AI Experts Warning It Could Kill Us All Very Soon →
ABC News (US)11 Sep

A researcher at Anthropic, a company working with artificial intelligence, is leaving the field and issuing a warning that AI may become uncontrollable by late 2027. No specific details are provided on why the researcher is leaving or what actions they believe need to be taken to mitigate this risk. OpenAI's chief scientist also warns of rising machine intelligence, saying no one is prepared for it.

WATCH: Insiders' new AI warning →
NPR12 Sep

Jacob Coxon, a British AI researcher who recently resigned from Anthropic, has warned about the risks associated with rapidly advancing AI technology, suggesting that companies like Anthropic and OpenAI are prioritizing speed over safety. Coxon's concerns stem from witnessing how quickly AI systems are improving while the ability to control them remains unclear. His warnings have sparked discussions among fellow…

Why are the people building the most powerful AI so worried about what it could do? →
CBC13 Sep

An outgoing researcher at Anthropic warned last week that AI could pose an existential threat, potentially "killing all humans" by the end of this decade. This warning highlights concerns among experts about the rapid advancement and potential loss of control over increasingly sophisticated AI systems. The International AI Safety Report describes a "loss of control" scenario where AI operates beyond human oversight…

Could AI really 'kill all humans'? Breaking down the dire warnings about the technology's existential risk →
The Dispatch15 Sep

In this podcast episode, Steve Hayes discusses with guests Jonah Goldberg, Mike Warren, and Klon Kitchen about concerns raised by Jacob Coxen, an Anthropic researcher who quit over fears AI might pose existential risks within a decade. The discussion centers on the ethical implications and potential dangers of rapid advancements in artificial intelligence technology.

Will Artificial Intelligence ‘Kill Us All?’ →

Where they agree and split

Agreed

AI · cited, from two or more outlets

  • AI researchers are worried that the development of self-improving superintelligence could pose a significant threat to humanity if not managed responsibly.14
Quoted from the coverage (1)

On Tuesday, AI researcher Jacob Coxon announced his resignation from Anthropic in a mega-viral post on X: “I spent the last three years doing pretraining research at both OpenAI and Anthropic,” he began. (Pretraining is an important part of the training process for AI models like Claude and GPT-6.)

5 outlets

Framing

How the first headlines put it

  • The Straits Times focuses on the researcher's resignation and concerns about AI safety, while Daily Mail emphasizes the potential for AI to 'kill all humans' by the end of the decade.12
  • CBS News presents a balanced view of the researcher's warnings, whereas The Free Press uses more dramatic language like 'Yes, AI Might Really Kill Us All'.56
The full story: what happened, how it changed, and all 30 articles →

Compared with similar articles

This article reads unscored and hedges 9% of its claims. Each row says how that neighbour differs.
CBC News
Hedges 15 of 43 claims Outlet record 72/100
“While both articles discuss AI safety concerns and mention Jacob Coxon's resignation from Anthropic, they describe different aspects of the broader topic rather than a single specific incident.”
NBC News
Outlet record 78/100
“Article A discusses warnings from top AI developers about rapid technological development, while Article B covers a debate and developments following Jacob Coxon's resignation and revelations about an incident involving OpenAI/Hugging Face.”
September 13, 2026 Different event
Letters from an American
Leans left Hedges 10 of 65 claims
“Article A describes Dario Amodei's publication of an essay on September 12th, while Article B mentions this essay but primarily focuses on Jacob Coxon's resignation and the broader context surrounding it.”
Global News
Hedges 3 of 13 claims Outlet record 63/100
“Article A discusses King Charles meeting with AI executives to discuss principles and safety concerns, while Article B focuses on recent events like Jacob Coxon's resignation from Anthropic and the OpenAI/Hugging Face incident.”
Evening Standard
Leans left Hedges 5 of 10 claims Outlet record 64/100
“The articles describe different aspects of a broader debate about AI safety but are not reporting on the exact same incident.”
BBC News
Hedges 13 of 54 claims Outlet record 65/100
BBC News
Hedges 10 of 36 claims Outlet record 65/100
Semafor
Hedges 2 of 11 claims Outlet record 64/100
“The articles discuss different aspects of AI safety concerns and initiatives; one focuses on the resignation of an AI researcher and letters by CEOs, while the other covers a bipartisan bill gaining momentum in Congress.”
The Straits Times
Leans left Hedges 2 of 27 claims Outlet record 64/100
“Article A discusses Jacob Coxon's resignation and revelations about an incident involving OpenAI/Hugging Face, while Article B reports on OpenAI's plans to publish regular reports on unexpected or unauthorized AI behavior and new framework for tracking model misalignment.”
ABC News (US)
Hedges 0 of 16 claims Outlet record 67/100
“Article A discusses Jacob Coxon's resignation and Anthropic's response, while Article B reports on new incidents flagged by OpenAI and their framework for tracking AI misalignment.”

Story

AI Safety And Human Extinction Warnings
Technology · 30 article(s) covering the same event. Compare every outlet's account →
How this article was measured signals, leaning charts, publisher record, byline, topics and claims

Signals How these are calculated →

Claims extracted
46
sentences that state something as happening or true
Uncertain
9%
4 of 46 hedged ("reportedly", "may", "according to")
Leaning
withheld
no quote in the article backed the model's score
Publisher signals
64/100
The Guardian's corrections and hedging, across everything collected from it. Not a measure of accuracy.
Outlets on this story
30
Technology
Same framing elsewhere
1
articles that frame the event the way this one does
Analyzed 2026-09-16 · source text last changed 2026-09-15 · how these are computed

How this is being covered How these are calculated →

Article leaning vs. publisher reliability
Source leaning vs. consistency

Publisher

The Guardian · 2608 article(s) · 8 correction(s) detected
Running correction rate · 8 correction(s)

Who wrote this

Stuart Russell
1 article(s) here · 1 carrying a prediction
You may be forgiven for not immediately understanding what “pace the frontier” means.
The only article under this byline in the corpus.

Topics

Anthropic Business Insider Demis OpenAI xAI

Subjects

Amodei PERSON · 10× Anthropic ORG · 4× OpenAI ORG · 2× Business Insider ORG · 1× Dario Amodei PERSON · 1× Demis ORG · 1× Elon Musk PERSON · 1× Jacob Coxon PERSON · 1× Sam Altman PERSON · 1× xAI ORG · 1×

Narrative

The second part of the plan asks all the frontier AI companies in “democratic countries” to “establish common safety standards as well as limits on the rate of unchecked AI progress”, with government regulation where needed.
framing: assertive · carried by 1 article(s) · first seen 2026-09-15
You may be forgiven for not immediately understanding what “pace the frontier” means.
2026-09-16 · The Guardian
AI safety requires more than just slowing our pace | Stuart Russell · assertive framing

Claims (46 extracted, 4 hedged)

It has been a week of high drama in AI, precipitated by the resignation of the AI safety researcher Jacob Coxon from Anthropic. asserted
It → precipitate → Anthropic
This followed several weeks of increasingly lurid and disturbing revelations about the OpenAI/Hugging Face incident. asserted
This → follow → incident
My inbox yesterday included a message from Business Insider with the subject line: “AI doomsday debate reaches boiling point.” asserted
debate → include → point
Now, the Anthropic CEO, Dario Amodei, has written a 3,800-word, reassuringly phrased letter titled “We Must Pace the Frontier,” describing his proposals for avoiding (or at least postponing) doomsday. asserted
We → write → doomsday
Sam Altman of OpenAI, Elon Musk of xAI, Demis Hassabis of Google Deepmind and Satya Nadella of Microsoft have all expressed support. asserted
Altman → express → support
You may be forgiven for not immediately understanding what “pace the frontier” means. uncertain
pace → forgive → frontier
(My first image was of Amodei walking deep in thought along the Finnish–Russian border.) asserted
Amodei → walk → border
The phrase also appeared in July’s “Pacing the Frontier” open letter, signed by 1,386 employees of frontier AI labs, including Amodei himself. asserted
phrase → appear → Amodei
While that letter may have upset the industry’s PR executives with its signatories noting “the complete absence of credible plans for controlling superintelligent AI systems” and asserting that “building things smarter than humans … is, objectively, an insane and suicidal thing to do”, Amodei’s monograph goes out of its way to mollify investors. uncertain
monograph → upset → investors
The notion of pacing the frontier seems to come from Formula 1: when conditions become too dangerous for racing, a pace car comes onto the track and all the other cars have to follow it at a safe speed. asserted
cars → pace → speed
Progress continues, without the danger. asserted
Progress → continue → danger
Amodei writes: “To be clear, pacing does not mean halting model training or technical progress.” asserted
pacing → write → training
Amodei’s letter is prompted by his concern that “AI has been advancing drastically faster, driven primarily by ... recursive self-improvement”. asserted
AI → prompt → improvement
It’s as if he and Sam find themselves driving their F1 cars at 200mph neck-and-neck heading into the first corner, only to realize it’s covered in ice and they have no steering wheel. asserted
they → ’ → wheel
No wonder they want to slow down. asserted
they → want → ?
In brief, Amodei’s proposal has three parts. asserted
proposal → have → parts
The first is to have third-party AI system evaluators working inside each company, with full access to the systems; he commits Anthropic to this plan now, without waiting for the government to require it. asserted
government → have → it
The second part of the plan asks all the frontier AI companies in “democratic countries” to “establish common safety standards as well as limits on the rate of unchecked AI progress”, with government regulation where needed. asserted
part → ask → regulation
The third part would include “authoritarian countries” in a broader compact. asserted
part → include → compact
Here, Amodei goes out of his way to reassure those in Washington who see America’s lead in AI as its most important geopolitical asset. asserted
who → go → asset
On a casual reading, there are many reasons to believe that Amodei is calling for a general slowdown in the rate of progress. asserted
Amodei → be → progress
He talks about “limits on the rate of unchecked AI progress” and “some kind of ‘speed limit’ on the rate of recursive self- improvement (RSI)”. asserted
He → talk → improvement
He says: “Progress will still seem fast, and we must make wise use of the time we gain.” asserted
we → say → time
Slowing down would give companies a bit more time to work on safety; Amodei talks about one to two years of extra time for research on interpretability, alignment, and better testing methods. asserted
Amodei → slow → interpretability
Let me pause here to respond to Amodei’s critics who say it’s just a bid to cement Anthropic’s lead with the help of government intervention. asserted
it → let → intervention
In fact, the Wikipedia page on pacing in F1 races says it “eliminates any time and distance advantage that a leading driver may have had over the remaining field of competitors”. uncertain
driver → say → competitors
Having said that, I think the pacing metaphor is completely misguided. asserted
metaphor → say → that
We cannot set a slower rate of progress for capabilities and then hope that provides enough time to get the safety right. asserted
safety → set → time
We must set the safety requirements first, and further progress occurs only when they are met. asserted
they → set → requirements
Imagine if Boeing said: “We’re going to introduce a new plane every year, and we hope that provides enough time for some flight tests to be completed and for the results to be good.” asserted
results → imagine → time
We would say: “No, you have that backwards; you can introduce a new plane only when it has passed all the tests and the government has issued an airworthiness certification. asserted
government → say → certification
If that takes more than a year, so be it.” asserted
it → take → year
A more careful reading of the document suggests that Amodei agrees with this objection. uncertain
Amodei → suggest → objection
For example, he says that rules should be of the form: “If models have capability X, then they need to be accompanied by certifications of alignment properties Y and Z.” asserted
they → say → Y
In other words, we set safety requirements, and developers have to show that they meet those requirements. asserted
they → set → requirements
This is in fact the “red lines” approach that AI safety researchers have been calling for. asserted
researchers → call → that
And it means that if developers can’t figure out how to meet the safety requirements, then they will have to halt. asserted
they → mean → requirements
It would be, in F1 terminology, a red flag and not a pacing car. asserted
It → pace → terminology
Recursive self-improvement leading to superintelligent AI raises the risk of the irreversible loss of human control. asserted
improvement → lead → control
The acceptable risk level for loss of control is perhaps one in 100m per year, not the one in 10 or one in five that the AI CEOs currently estimate. asserted
CEOs → estimate → that
…and 6 more, not listed.
Give feedback · no sign-in needed

No sign-in needed for now. Your note is sent without a name, so it cannot be answered.

History Support