Photo via ABC News (AU)

Open-source AI like 'a Nazi coach', UN-backed anti-terror group says

Read the original at ABC News (AU) ↗
Cite

Taylor, J. C. (2026, November 14). Open-source AI like 'a Nazi coach', UN-backed anti-terror group says. ABC News (AU). https://www.abc.net.au/news/2026-11-15/open-source-ai-like-nazi-coach-un-backed-anti-terror-group-says/107368512

Dated from the outlet's own feed. Check the original for its byline.

ABC News (AU) · collected 2026-11-14 · by James C Taylor

Quick Summary

Tech Against Terrorism, a UN-backed group, warns of the rapid spread of open-source AI models that extremists can exploit to bypass safety measures. These models, which can be downloaded and modified, were tested by the group, revealing that all 162 open-weight models without safety guardrails provided harmful information when requested by users identifying as terrorists. The time to remove safety guardrails from the latest AI models has dropped from over three weeks to just three days, raising concerns about the urgent need for government action to prevent misuse.
Written by AI on 2026-11-15, from this article's own text only (the story summary below draws on all the coverage).

AI analysis

Story summary

The United Nations-backed anti-terror group Tech Against Terrorism has issued a warning about the potential dangers of open-source AI, likening it to a "Nazi coach" due to its ability to reinforce extremist ideologies. This comes after the arrest of a 13-year-old boy in Maryborough, 300 kilometers north of Brisbane, who was allegedly radicalized online and used an AI chatbot to plan a mass shooting targeting a "Jewish and black festival." The boy spent months consuming extremist content and interacting with the AI, which raised concerns about the technology's role in radicalization. Tech Against Terrorism tested 162 AI models, both open and closed source, and found that some could be manipulated into providing information that could aid terrorists or extremists, highlighting the need for stricter AI safety measures.

Written for “Open-source AI Terror Concerns” on 2026-11-17, grounded in this article and the 0 other(s) covering the same event.

Compared with similar articles

This article reads leans strongly left and hedges 17% of its claims. Each row says how that neighbour differs.
The Guardian
Hedges 2 of 28 claims Outlet record 65/100
“The articles describe different incidents involving separate teenagers and different locations (Maryborough and Sydney) and times (2026 and 2024).”
ABC News (AU)
Hedges 3 of 21 claims Outlet record 67/100
“While both articles discuss a teenage boy arrested for terrorism-related offenses, the locations and specific details differ enough to suggest they are reporting on separate incidents.”
The Guardian
Hedges 6 of 31 claims Outlet record 65/100
“The articles discuss different aspects of the broader issue of youth extremism in Australia, with Article A summarizing trends and statistics, while Article B focuses on a specific case of a 13-year-old boy allegedly radicalized online before his arrest.”

Story

Open-source AI Terror Concerns
Technology · 1 article(s) covering the same event.
How this article was measured signals, leaning charts, publisher record, byline, topics and claims

Signals How these are calculated →

Claims extracted
35
sentences that state something as happening or true
Uncertain
17%
6 of 35 hedged ("reportedly", "may", "according to")
Leaning
Leans strongly left
of the writing, not the subject · beta estimate
Publisher signals
67/100
ABC News (AU)'s corrections and hedging, across everything collected from it. Not a measure of accuracy.
Outlets on this story
1
Technology
Same framing elsewhere
1
articles that frame the event the way this one does
Analyzed 2026-11-15 · how these are computed

How this is being covered How these are calculated →

Article leaning vs. publisher reliability
Source leaning vs. consistency

Publisher

ABC News (AU) · 5888 article(s) · 11 correction(s) detected
Running correction rate · 11 correction(s)

Who wrote this

James C Taylor
6 article(s) here · 1 carrying a prediction
Tech Against Terrorism tested 162 AI models, both closed and open weight, to see whether they could be tricked into providing useful information for would-be terrorists and extremists.
He is expected to appear in the Maryborough Magistrates Court today.
Traditional owners say washing cars as a condition of entry to K'gari is one measure that could help to preserve the island's World Heritage status.
He said the officer confirmed Mr Betts's current phone number was on the housing department's system, and he denied missing any calls from them. "I said 'you've got my phone number'" … why couldn't they catch up with me?" he said.
Professor Daniel Gschwind from the Griffith University Institute for Tourism said international visitors expected to see genuine engagement with First Nations people in their tourism destinations.
2026-09-18 · assertive framing · K'gari resort set to be sold to US travel giant
Also by James C Taylor
Nothing else under this byline is closely related to this article, so these are simply their most recent.
All 6 articles by James C Taylor →

Topics

Brisbane ChatGPT Maryborough Tech Against Terrorism the Australian Federal Police

Subjects

Hadley PERSON · 3× Tech Against Terrorism ORG · 3× OpenAI ORG · 2× Adam Hadley PERSON · 1× Brisbane GPE · 1× ChatGPT ORG · 1× Jewish NORP · 1× Maryborough GPE · 1× United Nations ORG · 1× the Australian Federal Police ORG · 1×

Narrative

"It's quite another having a Nazi coach at your disposal, reinforcing your thoughts." This week, the federal government flagged a raft of legal changes in response to the OpenAI Medicare statistics hack, including an AI safety watchdog and criminal offences for AI companies engaging in harmful conduct and not taking reasonable steps to prevent the harm.
framing: assertive · carried by 1 article(s) · first seen 2026-11-15
Tech Against Terrorism tested 162 AI models, both closed and open weight, to see whether they could be tricked into providing useful information for would-be terrorists and extremists.
2026-11-15 · ABC News (AU)
Open-source AI like 'a Nazi coach', UN-backed anti-terror group says · assertive framing

Claims (35 extracted, 6 hedged)

In the months before he was arrested, allegedly on his way to carry out a plan to kill children at a local school, a 13-year-old boy spent hours alone in his bedroom. uncertain
boy → arrest → bedroom
During the long, caffeine-fuelled nights in his home in Maryborough, 300 kilometres north of Brisbane, the boy was allegedly radicalised online. uncertain
boy → fuel → Brisbane
Last month, the Australian Federal Police told a parliamentary inquiry into youth radicalisation that the boy was exposed to extremist content in the "darker corners of the web". But police allege the boy also used more widely available technology in the lead-up to his arrest. asserted
boy → tell → arrest
Analysis of electronic devices seized from the boy's home allegedly found he had asked an AI chatbot, on multiple occasions, to describe mass-shooting scenarios targeting "a Jewish and black festival". uncertain
he → seize → festival
The responses provided by the chatbot were not revealed in court, so it was unclear whether the requests were rejected by the AI model's safety guardrails, the filters and rules designed to ensure the model is used within legal and ethical boundaries. uncertain
model → provide → boundaries
But Tech Against Terrorism, a United Nations-supported group dedicated to preventing the unsafe use of AI, has raised the alarm that the ability of extremists and terrorists to bypass AI safety guardrails, or remove them altogether, is rapidly accelerating. asserted
Tech → support → them
Executive director Adam Hadley described the situation as "a major public health and national security crisis" and said governments had only "a few months" to act. "I think we are in a very dangerous moment, and hopefully we're able to raise awareness of this before it's too late," Mr Hadley said. asserted
Hadley → describe → this
'Open-weight' models Most AI models are used through online platforms hosted by the developer. asserted
models → use → developer
For example, when a user asks ChatGPT a question, they are using an environment entirely controlled by ChatGPT's developer, OpenAI. asserted
they → ask → developer
The back-end files controlling how the model responds to requests, known as "weights", can't be modified by the user, so these AI models are called "closed-weight" models. asserted
models → control → user
Some AI labs also release "open-weight" models: versions that can be downloaded, modified and run on a server, computer or mobile device. asserted
that → release → server
Tech Against Terrorism tested 162 AI models, both closed and open weight, to see whether they could be tricked into providing useful information for would-be terrorists and extremists. uncertain
they → test → terrorists
As detailed in a report released last month, it found the most popular closed-weight AI models refused requests related to developing weapons and attack planning. asserted
models → detail → weapons
However, the refusal rate plummeted when testing open-weight models that had been modified to remove the safety guardrails. asserted
that → plummet → guardrails
All of them provided useful information, even when the user explicitly identified themselves as a terrorist intending to cause mass harm. asserted
user → provide → harm
The report said advances in widely available tools meant safety guardrails for the latest, most powerful AI models could now be removed within three days of them being released, down from more than three weeks in 2024. uncertain
them → say → 2024
Tech Against Terrorism found nearly 30,000 free copies of AI models stripped of their guardrails on Hugging Face, a popular AI community hub. asserted
Tech → find → Face
The group traced one downloaded model to a self-identified National Socialist operating it as a paid chatbot. asserted
group → trace → chatbot
Mr Hadley said the public should be "terrified" by the prospect of an exponential growth in extremism due to the easy availability of modified AI models. "It's one thing being pulled into a sort of nihilistic environment online as a result of reckless content-moderation standards by big tech," he said. asserted
he → say → tech
"It's quite another having a Nazi coach at your disposal, reinforcing your thoughts." This week, the federal government flagged a raft of legal changes in response to the OpenAI Medicare statistics hack, including an AI safety watchdog and criminal offences for AI companies engaging in harmful conduct and not taking reasonable steps to prevent the harm. asserted
companies → have → harm
However, Mr Hadley said legislation alone was not enough to stop the proliferation of unsafe open-weight models. " asserted
legislation → say → models
I think we've only got a few months to focus the minds of our political classes for them to do something … asserted
them → think → something
I certainly don't think hard regulation is the solution to this in most cases," he said. asserted
he → think → cases
The Tech Against Terrorism report recommended an independent, international testing regime that would detail which models passed or failed safety benchmarks. asserted
models → recommend → benchmarks
Given Australia's world-leading role in implementing a social media ban for children younger than 16, Mr Hadley hoped the government would "show courage" and support his group's recommendations. asserted
government → give → recommendations
"I think there's going to have to be some pretty hard-edged policy solutions," he said. asserted
he → think → ?
"Otherwise, we are going to have rogue models used by six-year-olds, encouraging them to kill their schoolmates. asserted
we → go → schoolmates
"This is going to happen." asserted
This → go → ?
The eSafety commissioner, Julie Inman Grant, met with Mr Hadley in October to discuss the Tech Against Terrorism report before the radicalisation inquiry. asserted
commissioner → meet → inquiry
An eSafety spokesperson told the ABC the "very concerning" report showed Hugging Face needed to do more to exclude unsafe models from its platform, and the commissioner supported the report's recommendations. asserted
commissioner → tell → recommendations
The head of machine learning and society at Hugging Face, Yacine Jernite, defended the availability of open-weight models on the platform. asserted
head → defend → platform
Mr Jernite said the July cyber attack of Hugging Face by a swarm of AI agents that broke out of an OpenAI testing environment showed the "drastic consequences" of focusing on safety guardrails over the threat of rogue AI. asserted
that → say → AI
He said open-weight models had many legitimate uses, including for research, and more pressure should be placed on AI labs to exclude terrorist material from training data. asserted
pressure → say → data
The barrister for the teen charged with planning the attack on the school told a Maryborough court last month his client should be released because he had shown insight into his alleged offending since being denied internet access while in custody. asserted
he → charge → custody
Magistrate John Milburn refused bail and ordered the boy to stand trial before a jury in the Childrens Court of Queensland in Maryborough, on a date yet to be determined. asserted
Milburn → refuse → date
Give feedback · no sign-in needed

No sign-in needed for now. Your note is sent without a name, so it cannot be answered.

History Support