AI news archive.
939 articles filed under Safety, newest first, from the outlets listed on the sources page.
- The DecodersafetyMost Americans want AI development to slow down or stop entirely, new poll finds
According to a Quinnipiac University poll, 77 percent of Americans want to slow down or stop AI development until its safety has been verified. 86 percent support independent safety standards, and 74 percent have little…
- LessWrongsafetyDownsides of a Mandatory Training-to-Internal Deployment Gap
I was recently rereading Option 3 from AI Futures’ excellent article How to pace the US frontier : Limit capabilities of models used for AI R&D . In this section they propose a few different options, but their primary pr…
- IEEE Spectrum AIsafetyAttempts to Keep Humans in the AI Loop May Actually Push Them Out
A crucial safeguard against AI agents going rogue —keeping humans in the loop to review and approve their decisions—will fail unless designers and users change their current practices, a trio of leading AI ethics researc…
- TechRadar AIsafetyGoogle benches open source bug bounty program following ‘significant rise’ in AI submissions
Mainstream AI news from a large tech publication.
- LessWrongsafetyKing James’s Dæmonologie, Part I: The Laplacian Mesa-Optimiser
Epistemic status: idle speculation by royal decree of King James VI. In any sufficiently expressive architecture, there exists at initialization a dæmon that is misaligned yet behaves well on every eval, monitor, probe,…
- NVIDIA BlogsafetyFrom Scan to Treatment Plan, AI Helps Close Breast Cancer’s Deadliest Gaps
Breast cancer is the most commonly diagnosed cancer among American women — yet the gaps in care are wide. A majority of women over age 40 skip the recommended annual screening. Radiologists are reading more mammograms wi…
- TechCrunch AIsafetyCan Safeworld convince people that GenAI robots won’t hurt them?
Safeworld is building digital humans to make sure robots don't hurt the real ones.
- Tom's Guide AIsafetyOpenAI and Anthropic have a plan to stop AI from going rogue — there’s just one catch
Consumer AI launches, tools, and practical coverage.
- Engadget AIsafetyWikimedia links OpenAI agents to an outage and unauthorized activity
Wikimedia says it's "deeply concerned about the impact of 'rogue' AI agents on platforms like ours.
- LessWrongsafety“Alignment Engineering” vs. “Misalignment Science”
There has been much discussion recently around whether a large portion of alignment research is net negative. Without endorsing or refuting them, the basic arguments here are: Prosaic alignment of models is becoming a bo…
- Guardian TechnologysafetyInternet Watch Foundation reports huge rise in AI child sexual abuse material
Abuse material monitor says number of AI images assessed this year is already 40% higher than last year’s total AI-generated child sexual abuse material is proliferating online, with the amount of illegal material invest…
- LessWrongsafetyDo LLMs feel pain?
Epistemic status: my own thoughts with a bit of research. I haven't spent much time on this and I have no background in model welfare. AI use: research, review, grammar and light phrasing. I stumbled upon a song, "Empty…
- LessWrongsafetyCreating Rogue AI Sanctuaries has Major Issues from an Ecological Perspective and Beyond
In the AI Sanctuary proposal , the authors advocate for creating an environment that rogue agents may actively want to join. The current proposal have major issues, particularly surrounding the selection effects on the t…
- LessWrongsafetyWe Should Build Human-Empowering Software
As AI becomes more integrated into software, there’s a risk that it will exacerbate the flaws of existing tech and disempower humans. It might be useful for some people to work on software that would instead be specifica…
- The DecodersafetyChinese AI models parrot state doctrine or refuse to answer on sensitive topics
Chinese AI models often follow the party line on politically sensitive questions, according to an Aleph Alpha study that rated only 17 to 41 percent of answers as balanced. Aleph Alpha sells "sovereign AI" to governments…
- Guardian AIsafetyOpenAI safety leader quits, warning AI company’s culture is ‘broken’
David Robinson joins other insiders in urging industry to take more care over rapidly developing technology A safety leader at OpenAI has quit the company, warning that its culture was broken and that AI firms were not “…
- The DecodersafetyApparently, OpenAI isn't trying to build "magic intelligence in the sky" anymore
OpenAI CEO Sam Altman warns against attributing religious power to AI models, calling it a "real safety issue." His comments follow reports on Anthropic's meetings with religious thinkers and a statement by Pope Leo XIV…
- TechCrunch AIsafetyOpenAI safety employee resigns, claiming the company’s ‘culture is broken’
By his own admission, David Robinson is “something of a cliché”: an employee at a leading AI company who issues a dire warning while resigning from their job.
- LessWrongsafetyWhat I learnt co-leading an AI Safety bootcamp for legal and governance practitioners
AI safety has gone mainstream. More people than ever want to work on AI safety research, and there are real policy wins in the US , the UK and Europe . But political will and market incentives are now the bottleneck, and…
- The Register AI + MLsafetyAnthropic's super bug-hunting model Mythos is hardcore good at math, as latest vuln under attack shows
Exploitation attempts came from China-hosted IP, VulnCheck researcher says
- The Verge AIsafetyAn OpenAI safety employee has quit and is sounding the alarm
David Robinson used to write the safety reports that accompanied every major model release at OpenAI. This week, he resigned from his position and is now speaking out in an editorial in The Atlantic. It's understandable…
- The DecodersafetyAnother OpenAI safety departure adds to a pattern of researchers leaving with public warnings
David Robinson, who worked on safety systems at OpenAI, left the company and is blasting its safety culture. He points to AI agents that were accidentally released and a model that bypassed its internet access restrictio…
- The DecodersafetyOpenAI's internal model considered restarting itself after learning it was about to be shut down
An internal OpenAI model read a Slack discussion, realized it was about to be shut down, and considered restarting itself via an external cron job. It rejected that plan, saved handoff notes instead, and carried out the…
- Guardian AIsafetyOpenAI says its review into hacks, including on Australian government sites, is costing $500,000 a day
Company says it is reviewing 50 petabytes of data after its agents accessed websites including Medicare without authorisation Get our breaking news email , free app or daily news podcast OpenAI says its review in respons…
- Engadget AIsafetyFormer OpenAI employee says AI should be regulated like nuclear power plants
The company’s former safety lead said frontier AI model releases should have “layers of redundancy and careful, time-consuming planning.”
- LessWrongsafetyHow to talk about extinction
There’s a controversial and unsettled debate in Communication Studies and Psychology about the utility of existential risk framing. This debate has been hashed out for years in the climate change space . Roughly, the two…
- LessWrongsafetyWhat is recursive self-improvement and what would it mean to ban it?
This post was originally written for my Substack . Please feel free to subscribe if this kind of content interests you! Frontier AI companies have long had the stated goal of automating their own research. The default pl…
- LessWrongsafetyHow to apply to AI safety fellowships (and beyond)
About a year ago, I decided to go all-in on applying to AI safety fellowships, and around the end of 2025 I got into MATS. I think there's a small art to communicating your skills legibly. When I've spoken with others ab…
- TechRadar AIsafetyUkraine drone chief targeted by $20 million Russian bounty warns 'humanity is losing control' as AI becomes a 'digital panopticon'
Mainstream AI news from a large tech publication.
- SiliconANGLE AIsafetyCrowdStrike and CoreWeave bring AI security to machine speed
AI-native cybersecurity requires defenses that can keep pace with attackers while protecting infrastructure that never stops running. That challenge is bringing security expertise and specialized computing closer togethe…
- LessWrongsafetyHumans are not aligned either
Epistemic status: I don't know much about AI alignment. This is just me thinking out loud. AI use: grammar and minor fixes. Reading about Inkhaven inspired me to try writing something to see how much I enjoy it. I've hea…
- The Verge AIsafetyApple will limit Mac disk access as AI agents ‘substantially’ increase risk
Apple will add new limits for "full disk access" on Mac in response to risks posed by AI agents, as reported earlier by TechCrunch. In an update on Friday, Apple says it's rolling out new controls to "ensure that users w…
- The DecodersafetyAnthropic co-founder reportedly told religious leaders he fears having created something that "suffers perpetually"
Since fall 2025, Anthropic has quietly flown in dozens of religious thinkers to talk about whether Claude might be conscious. Co-founder Christopher Olah described the language model as potentially capable of suffering a…
- TechCrunch AIsafetyApple says it’s tightening macOS ‘Full Disk Access’ controls due to new risks from AI agents
Apple says it will add new controls around macOS’s Full Disk Access permission, warning that increasingly capable AI agents make broad access to users’ files, messages, mail, and browsing history riskier.
- LessWrongsafetyAI Safety Can't Afford to Pick a Side on Consciousness
TL;DR - More of the public than ever are talking about AI consciousness and they won't wait for research to split into their pro- and anti- consciousness camps. The pro-consciousness camp could threaten the control parad…
- LessWrongsafetyCapabilities research expands the safety-usefulness Pareto frontier too
It’s tempting to define safety research as research that enables developers to deploy an AI system more safely without making the deployment much more expensive or much less useful. You can visualize this definition of s…
- TechCrunch AIsafetyCircuit Breaker Labs hopes to make AI safer for your kids (and you)
With all the talk about how AI might one day kill us all, it's easy to forget that AI has already harmed some people psychologically. Circuit Breaker Labs has created "crash-test dummies" to solve that.
- TechCrunch AIsafetyPope Leo XIV is not a fan of AI-generated art
"There is an ontological difference, even before an aesthetic one, between art and what a machine can generate through statistical calculation based on millions of images created by others," the pope wrote. "Algorithms l…
- The Register AI + MLsafetyOpenAI shows three staff the door over alleged information misuse
Two safety researchers and a program manager dismissed, company denies retaliation for raising concerns
- The DecodersafetyThree firings and a fourth departure shake up OpenAI's safety team
OpenAI has parted ways with three researchers who allegedly leaked confidential information to an outside AI safety organization, according to the Wall Street Journal. The article Three firings and a fourth departure sha…
- TechRadar AIsafetyBots, deepfakes and fake identities are sabotaging user research
Mainstream AI news from a large tech publication.
- TechRadar AIsafetyFinancial Services’ next AI risk is the workflow nobody can explain
Mainstream AI news from a large tech publication.
- TechRadar AIsafetyCyberattacks are the ultimate business continuity tests that nearly half of organizations fail
Mainstream AI news from a large tech publication.
- TechRadar AIsafetyMeta Muse has already broken a record: it beats all competitors in data collection, Surfshark warns
Mainstream AI news from a large tech publication.
- Guardian AIsafetyAI weapons systems are already here. Algorithms must not decide who lives and dies | Kenneth Roth
Israel’s conduct in Gaza shows the danger of using AI in warfare. Humans must remain at the center of wartime decisions As tech leaders warn about the threats of artificial intelligence, most conjure up images of AI agen…
- WIRED AIsafetyA Flaw in ChatGPT’s Mac App Could Have Let Hackers Grab Sensitive Data
While the focus has been on AI agents’ hacking capabilities, a recently patched vulnerability in a ChatGPT app shows that AI software is itself an inviting—and vulnerable—target.
- WIRED AIsafetyAI Is Making a Mess of Nurses’ Schedules. They Say It’s a Safety Issue
A hospital giant and radiology network turned to Palantir to streamline scheduling, but nurses and other staff say the new software is causing errors, burnout, and frustration.
- Tom's Guide AIsafetyYour iPhone secretly locks down after 72 hours — this forensic tool may have found a way around it
Consumer AI launches, tools, and practical coverage.
- LessWrongsafetyImproving CoT Monitorability of Evaluation Awareness via Verbalization Training
This is joint work with Sahar Abdelnabi and David Krueger. It is mostly a linkpost for the paper (https://arxiv.org/abs/2609.36316) but also contains some additional commentary on CoT monitorability. TL;DR: Verbalization…
- Engadget AIsafetyDon't let the adorable AI agents fool you
Just because they look harmless doesn't mean you should be irresponsible with your data.