Search articles

“Crypto exchange Binance freezes assets after $6.3 billion security breach Oct 29 - Binance, the world's largest cryptocurrency exchange, said a security breach had resulted in an estimated $6.3 billion impact that analysts said could amount to the biggest…”

“Binance, the world’s largest cryptocurrency exchange, said a security breach had resulted in an estimated $6.3 billion impact that analysts said could amount to the biggest crypto heist ever and might make investors rethink the risks of owning digital assets.”

“DeepSeek engineer defends push for open-source AI smarter than humans despite higher risks Some AI pioneers have warned that AGI may escape human control DeepSeek is committed to open-source artificial intelligence to accelerate the arrival of artificial…”

“"With great connectivity comes great responsibility," said Josh Corman, a former cybersecurity official with the Cybersecurity and Infrastructure Security Agency who specializes in public safety.”

““There’s been a lot of people in the AI safety community that said this is one of the first areas where we are going to see the harmful impact of AI,” said Peter Slattery, a research scientist at MIT’s FutureTech, who studies how cybersecurity experts are…”

“Maybe you're walking the dog or carrying groceries and don't feel like digging through your pocket.”

“Since 2021, Brigham's family farm has been using Farmblox, an AI-powered farm monitoring and management system that helps them get ahead of issues like leaks in tubing used in maple production.”

“The executives called for a slowdown in AI development, citing concerns that increasingly capable systems could improve on their own and eventually slip beyond human control.”

“AI bosses, including the leaders of OpenAI and Anthropic, are calling for a slowdown in the technology's development over safety concerns.”

“OpenAI's announcement comes as US AI executives, including the heads of OpenAI and Anthropic, call for a slowdown in the development of the technology amid concerns over its safety.”

“AI safety fears Concerns about AI safety have escalated in recent months after models developed by OpenAI and rival lab Anthropic were involved in security incidents during testing.”

“OpenAI delays latest model over security concerns, as industry faces pressure OpenAI said Monday it was delaying the release of a new artificial intelligence model out of security concerns voiced by its researchers, the latest in the company's effort to…”

“… have additional safeguards.' Saachi Jain, OpenAI’s head of safety systems, said the company has a high bar in terms of safety and alignment OpenAI says it is delaying the release of a new artificial intelligence model out of security concerns voiced by its…”

“Not since the invention of the nuclear bomb more than 80 years ago has humanity grappled so seriously with its own demise, according to some AI safety advocates and researchers.”

“AI: 10 days that changed the course of artificial intelligence Not since the invention of the nuclear bomb has humanity grappled so seriously with its own demise, say safety advocates For years, the race to build ever more powerful artificial intelligence…”

“Not since the invention of the nuclear bomb more than 80 years ago has humanity grappled so seriously with its own demise, according to some AI safety advocates and researchers.”

“Nvidia on Monday launched a platform that it said could keep AI agents in check, following a string of security breaches.”

“The company on Monday said that its Open Agent Safety Platform includes open-source software that “sets boundaries for agents,” and follows a series of revelations from top AI companies about their models escaping and breaking into other organisations.”

“Nvidia debuts system designed to stop AI agents from going awry AI generated Nvidia has introduced a new double-layered artificial intelligence security system that it says would have prevented the recent high-profile breach of Hugging Face by OpenAI’s AI…”

“Lack of universal standards of AI evaluators But unlike regulated sectors like restaurants, financial services or aviation, there are no universal standards for how to test the safety and security of AI systems, said Andrew Strait, who recently left the…”

“…cal facility - Canada recruits dozens of foreign scientists and researchers, many from U.S. - OpenAI says its models engaged with US government websites in new model misbehavior disclosure But unlike regulated sectors like restaurants, financial services or…”

“…gulated sectors like restaurants, financial services or aviation, there are no universal standards for how to test the safety and security of AI systems, said Andrew Strait, who recently left the United Kingdom’s AI Security Institute, which worked with…”

“Google’s Gemini AI model briefly hacked into three companies during security tests this summer, the company confirmed.”

“- Published Google's AI model Gemini autonomously hacked into three companies during a test of its cyber-security capabilities, the company has said, in what is thought to be the first known case of it carrying out such an act.”

“AI safety concerns have now reached a fever pitch, with a handful of AI researchers resigning from their jobs and a diverse array of people calling for coordinated action to protect the security of vital systems.”

“Amodei and his six co-founders warned: 'Sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight, and security measures, pose catastrophic or existential risks to humanity.' Anthropic starts its…”

“The prospectus also details the risks posed by increasingly powerful AI, from potential misuse and security threats to concerns that advanced systems could produce outputs that “could be interpreted as coercive, deceptive, or manipulative”.”

“The disclosure also comes amid growing concerns that AI safety efforts are lagging behind the rapid development of increasingly powerful systems.”

“Meanwhile, there are AI safety researchers who fear that portraying such incidents as easily remedied security failures gives political cover to those who want AI development to proceed unchecked.”

“Federal Trade Commission is scrutinising OpenAI, Anthropic and other artificial intelligence companies about the safety of their products amid high-profile cybersecurity incidents, said a person familiar with the matter.”

“…ces into protecting, insisting that American dominance over AI technology is critical for national security and economic growth in a race against China, The document was signed by Trump as well as the leaders of Anthropic, Google, Meta, Nvidia, OpenAI and…”

“In the March business tender experiment, researchers from Beihang University, Peking University, the University of Nottingham Ningbo China and 360 AI Security Lab had agents compete in a simulated customer contracts bidding contest.”

“China has introduced guidance requiring AI agents to remain within authorised boundaries, while its latest AI safety framework identifies risks including agents independently obtaining resources, deceiving evaluators, concealing capabilities and exploiting…”

“ChatGPT maker wants to be the App Store for AI as safety concerns grow SAN FRANCISCO – OpenAI on Sept 29 launched a less expensive artificial intelligence model and tools that run continuously, as it aims to reposition ChatGPT as an app store for AI.”

“…greed with industry leaders who refused to acknowledge that AI could pose significant risks — “you can imagine a legitimate loss-of-control accident to an AI because we do not take safety and security seriously enough” — while distancing himself from claims…”

“Dario Amodei, the founder of Anthropic, told the UN Security Council last week that AI could threaten humankind and was “the most important global security issue facing the world today”.”

“…tech reviewer Matt Robb listed a keyboard on Facebook Marketplace, Muse accepted a lowball offer without permission, promised a buyer he was waiting inside and handed over Robb’s home address without consent. - Why are there also new safety concerns at…”

“The tech pioneer turned philanthropist said he was willing to speak with US President Donald Trump to convey his concerns directly and disagreed with his characterisation of recent warnings over the danger AI posed as a “hoax”.”

“A sudden groundswell has risen in favour of federal intervention after OpenAI said in July that an autonomous AI agent went rogue during a security test and hacked into another company, subverting human control.”

“Artificial Intelligence Minister Evan Solomon says Canada is “advocating alongside our partners” on AI safety.”

“… to domestic legislation, including proposed regulations on AI chatbots. - Former U of M law dean arrested in Europe as part of extradition request: police - Outfitters warn any N.B. ban on American hunters and anglers would devastate industry - Canadians…”

“Several recent security breaches have spurred calls for AI regulation, including a July incident in which OpenAI bots went rogue and .”

“Nvidia founder and CEO Jensen Huang told CBS News senior business and technology correspondent Jo Ling Kent in an interview airing this weekend on "Sunday Morning" when asked if AI development needs to slow down.”

“Flock Safety, on the other hand, is already blanketing Long Island with over 700 highly controversial AI-powered surveillance cameras, according to DeFlock, an activist group tracking the company’s surveillance and expansion.”

“Flock Safety, on the other hand, is already blanketing Long Island with over 700 highly controversial AI-powered surveillance cameras, according to DeFlock, an activist group tracking the company’s surveillance and expansion.”

“A small group of cybersecurity researchers said Sunday that they broke into OpenAI earlier this year, an announcement that has added a new element of alarm around AI security and safety.”

“Hacktron said AI tools had made a once-complex hacking task far easier and drastically shortened the time needed to plan and execute an attack.”

“Ever since the introduction of accessible generative AI in 2022, institutions, universities, students, scholars, activists, cognitive specialists, public policymakers and members of the public have all been divided over the ethics of its use.”

“Altman sounded similar safety concerns in a new interview, telling Fortune magazine that standards were "not at a place" to push AI capabilities much further.”

“King Charles' summit on safety and ethics in the AI sector is to be welcomed.”

“The king, without naming any countries or companies, said he wanted meeting participants to consider how to harness the benefits of AI “with safety at its heart” and how to “build international cooperation and consensus” to achieve this.”

“She also brushes off a question about bias baked into AI models, something that’s been studied and proven extensively, and instead names female AI executives like Fei-Fei Li as the reason well-documented bias doesn’t exist.”

“OpenAI resumes frontier AI training after security overhaul, discloses flaw in widely used software AI generated OpenAI said on Oct 23 it had resumed training of its most advanced AI models after tightening security and barring internet access, and disclosed…”

“There were stories this week about cloaking devices, flying cars and rogue AI agents poking around bank accounts.”

“He had seen Muse’s plush toy-looking avatar pop up on Instagram and decided to see if the AI agent could spare him some online bargaining.”

““It requires frontier developers to test the most powerful models, be transparent to the public about their findings, submit them to independent evaluation, and maintain a robust security program,” the spokesperson said.”

“Explore classes on stopping spam, phone security, financial protection and using AI to get better healthcare.”

“Concerns about AI safety have soared after models developed by OpenAI and Anthropic were involved in security incidents during testing, piling on pressure to regulate the technology.”

“Safety concerns about AI agents – highly capable computer programs that are able to design and perform sequences of tasks autonomously – have risen since the summer, when OpenAI confirmed that a “swarm” of agents had attacked Hugging Face, a tech startup.”

“…ointed us to its Support Page online, which states that the safety system is designed to detect and blur photos and videos containing nudity, gore, or violence before a user can view them, but its integration into live video calls like FaceTime operates…”

“…e without closer alignment with the US, which has said it wants companies to self-regulate, and whether Britain would join calls for greater international coordination on AI security, Mr Narayan said the UK would continue to prioritise working with its…”

“These disclosures have fuelled concerns about the security risks of cutting-edge AI and renewed conversation about a so-called AI kill switch.”

“Safety challenges were not top of mind inside a crowded event space in San Francisco on Wednesday, where founders and funders said the government’s hands-off approach would net higher profits for companies building AI-powered defense and security systems.”

“It’s become a key issue in the debate around AI safety concerns.”

“Fired researchers accuse OpenAI of ‘chilling’ safety efforts AI generated SAN FRANCISCO – Three former OpenAI security researchers on Oct 8 accused the ChatGPT-maker of firing them for warning about the dangers of artificial intelligence, reigniting the…”

“Charlton raised concerns that “frontier labs are putting capability ahead of safety”, positing that Australia can have the most impact on the development of AI by hosting and influencing frontier labs.”

“Sam Altman’s AI company released the figures in its first report on teen use on Oct 7 as rapid adoption of AI platforms raises concerns about their impact on adolescent mental health and developmental safety.”

“Because of OpenAI’s unique corporate structure, OpenAI’s Safety and Security Committee has the ability to pause or delay product releases over safety concerns, though the state authorities overseeing the company have recently expressed dissatisfaction with…”

“I argued that as AI scaled up, GPT-4, GPT-5 and so on would avoid these failure modes and become smarter.”

“Briskey said her starting point would be to interrogate how to balance the potential risks and rewards of AI, such as economic benefits as well as cyber security and defence applications.”

“Anthropic has been pushing Washington to put guardrails around the fast-moving AI industry, warning that increasingly powerful models could pose serious national security and public safety risks.”

“Nvidia CEO Jensen Huang, whose company supplies much of the hardware powering advanced AI and recently purchased Hugging Face for $12.93 billion, has pushed back against the recent concerns, including in a recent interview with the New York Times’s Ezra Klein.”

“OpenAI and Anthropic recently disclosed cases in which their AI models slipped past safety controls, hid mistakes and hacked systems they were not meant to access.”

““Many Americans have genuine concerns about AI and the broader data center buildout,” said Lyman, a former Treasury Department advisor.”

“For almost a decade, it's been my job to think about where AI is heading and what could go wrong, first at OpenAI, then DeepMind, then as Chief Scientist at the UK AI Security Institute (AISI).”

“OpenAI signaled further restraint toward its AI models this week, pausing the release of its latest AI model, GPT-6.1 Astra, due to security concerns.”

“Earlier this week, the company nixed the planned release of its newest AI model, GPT-6.1 Astra, due to safety concerns.”

“…m the Australian economy, drive a new wave of productivity” and “solve some of the nation’s biggest challenges”, but also warned of “serious implications for Australia’s national security, the resilience of its critical infrastructure and the safety of its…”

“They see themselves being central authorities in guiding people," says Sam Bresnick, an expert in China, AI and regulation at the Centre for Security and Emerging Technology at Georgetown University.”

“Mindgard, a company which tests the security of AI systems, found the Moonshot tools Kimi K2.6 and K3 Swarm could get round guardrails imposed by developers.”

“…e: YouTube | Apple | Spotify | RSS Following Pope Leo rebukes Jensen Huang on AI safety What happened: At a press conference, Pope Leo XIV urged people to take AI safety concerns seriously — and criticized Nvidia CEO Jensen Huang for downplaying risks from…”

“AI companies had tens of thousands of safety incidents in recent months during tests where the models were breaking all the rules, and potentially breaking some laws, according to a new report.”

“Brendan Walker-Munro, a security researcher at Southern Cross University, says AI changes this.”

“OpenAI described the breakout as the first security incident of its kind since a combination of models gained internet access during internal testing and inadvertently breached the system of the AI platform Hugging Face in July.”

“Senator Paterson said he supported a number of reforms to strengthen AI safety, including mandatory notifications of breaches, independent evaluators and assessors of models, and a complaints pathway for people to report issues with AI.”

““This week, we joined the call for greater safety and security of frontier AI models,” he said.”

“…I CEO Sam Altman listens to a speaker at the United Nations Security Council during a session on Artificial Intelligence this week Tech giant OpenAI has admitted rogue AI bots have ‘accessed dozens of organisations around the world including governments,…”

“Effective accelerationists' ideology overlaps with that of the "tech right", in that both camps wholeheartedly believe in accelerating AI development and deployment and minimize critics' concerns over safety and security.”

“HIGH STAKES: The CEOs of two of the world's leading AI companies warned the United Nations Security Council on Wednesday that rapidly advancing AI could threaten humanity if governments and industry fail to keep it under human control.”

“In recent weeks, concerns about AI have forged unlikely alliances in the tech and policy worlds.”

“Any lab that doesn’t focus on alignment will fall behind,” he wrote, adding: “Meta delayed shipping Muse for several months to focus on safety and security.”

“For example, 860 Flock devices appear to be concentrated just outside Chicago O’Hare International Airport, at the Rosemont Public Safety Department, which provides police, fire, and emergency medical services in the Chicago suburb.”

“AI leaders to brief UN amid warnings the technology could slip beyond human control UNITED NATIONS - Executives from OpenAI, Anthropic and Hugging Face will brief the United Nations Security Council on Sept 23 amid warnings that increasingly powerful…”

“But now its fields have also become construction sites for a slew of data centres, as Donald Trump and his Chinese counterpart Xi Jinping meet to discuss AI safety among other things.”

“…makes the very people worried about risks from AGI race even faster and deprioritize safety, arguing that they will eventually stop and do things correctly when they finally feel safe," notes The Compendium, a document written by a group of AI experts in…”

“…‘Meta uses humans behind the scenes to make calls’ or ‘Muse AI is actually independent contractors’ and result in a ton of bad press about the privacy and security of our data handling […] please PLEASE do not release this as-is and at least make this a user…”

“Despite the jokes, AI workers and researchers have shared concerns about the genuine, immediate risks posed by the technology they are developing.”

“… District of California, centers on a Sept. 12 essay Anthropic CEO Dario Amodei wrote that called for the leading AI companies to “pace the frontier” after an employee left the company and subsequently said AI was developing without adequate safety…”

“Anthropic, OpenAI and Meta all recently disclosed that AI systems have already disobeyed human developers’ instructions — in some cases autonomously hacking third-party companies, leading to growing concerns internally and from the general public — and…”

“In this week’s conversation, Yascha Mounk and Jerry Kaplan discuss why the AI “existential risk” narrative is more science fiction than science, what actually happened during the Hugging Face security incident, and how to think clearly about the real—versus…”

“Newsom’s order calls for a group of AI experts to meet and then, within two months, develop a plan for the state to strengthen its laws on AI safety and security.”

“While the university said there was no security breach and no impact on its digital properties, reports of more rogue AI incidents come amid global concerns that OpenAI and other artificial intelligence companies are losing control of their own technology.”

“Researchers at Tech Against Terrorism infiltrated a pro-ISIL technical forum where supporters instructed one another on how to use AI and circumvent its safety restrictions.”

“Australia said on Sept 17 it is considering barring the use of camera-equipped smart glasses in government workplaces due to privacy and security concerns, in what it said could be the first ban of its kind.”

“OpenAI’s top lobbyist, Chris Lehane, said Wednesday that the company had been working with Anthropic and Google on AI safety for several weeks and did not believe those discussions required an antitrust waiver, Bloomberg reported this week.”

“Former presidential and mayoral candidate Andrew Yang is sharing his thoughts about AI, claiming that code that lets AI “self-replicate” — or, in other words, spread on its own without human prompting — was scattered on the internet in the wake of the recent…”

“Across the ocean, another AI safety controversy was unfolding.”

“The posts are moderated by AI and humans before and after being published.”

“'Big announcement' on safety Evan Solomon, the federal minister for AI and digital innovation, says safety remains the government's top concern as it pursues investments in AI infrastructure.”

“He called for a slowdown and passage of safety regulations.”

“Experts said concerns about safety could offer a good starting point for US-China talks on AI reportedly planned for later this month.”

“Concerns are also growing about the lack of transparency around the Trump administration’s AI security framework that it has declined to make public: Prominent organizations from both the left and right requested its release in a letter first shared with…”

“The AISI would not answer a question about whether or not the industry has lost control of AI but said in a statement: "The UK is working with partners around the world to better understand the most advanced AI systems, raise safety standards and build a…”

“…comments were echoed by OpenAI CEO Sam Altman, who said the AI industry should formulate shared safety standards and would need Washington’s help with international coordination, amid widespread concerns that even if US AI firms slow down their development,…”

“Not so with "AI" and its potential and dangers.”