Tracking AI existential risk. Source-backed context. Original reporting always linked.

MONITORING CORE AI-RISK FEEDS · UPDATED HOURLY

Topic dossier

Analysis

Recent evidence, sources and high-relevance stories in this PDOOM topic.

-- stories here -- sources -- essentials

Zac Boring 18 days ago Analysis

Corrigibility Prizes for Existing Work

via LessWrong AI [9] — One of my goals for the Corrigibility Research Fund is to retroactively encourage high-quality research on AI alignment (and corrigibility in particular) by awarding prizes. Back in July, I got my feet wet as a fund manager by handing out $27,000 to reward…

Zac Boring 18 days ago Analysis

A ‘Morally Binding’ White House Accord on AI Safety

via Substack Zvi [5] — The leaders in AI were invited to the White House.

Zac Boring 18 days ago Analysis

The world's best gradual disempowerment model organism: Frontier AI labs

via LessWrong AI [5] — Subtitle: And maybe second best is AI safety?Further reading: So many things, but: Gradual Disempowerment, The Normalization of Deviance in AI Development, Let’s Think About Slowing Down AI, Doom as a bad method, not a utopia tradeoff, Teleoperated…

Zac Boring 19 days ago Analysis

Astra 6.1 Pulled As Insufficiently Aligned

via Substack Zvi [3] — We once again got a new set of warnings yesterday, and new movement towards living in a sane world.

Zac Boring 19 days ago Analysis

Thank you to the AI safety people

via LessWrong AI [5] — I was born at the end of the cold war, unaware of the danger we were emerging from. Duck and cover drills (as if those could protect schoolchildren from a nuclear blast) were a curiosity of the past.The farmer-poet Wendell Berry, who wrote about the dread…

Zac Boring 20 days ago Analysis

The likely outcome of an AI pause is that we unpause too early and everyone dies

via LessWrong AI [4] — As of a few months ago, I had this simplified mental model where either AI developers race ahead and kill everyone, or we coordinate a pause and things go okay. But my old mental model underrated the likely possibility that we get a global pause on AI,…

Zac Boring 20 days ago Analysis

AI Safety Agendas

via LessWrong AI [5] — A map of the AI safety field's problems and agendas, and a request for your ratingsWe built aisafetyagendas.com, an interactive map of AI safety research agendas and how they map to different problems in alignment. The rows are 12 core problems, the…

Zac Boring 20 days ago Analysis

Character training can mitigate reward hacking, but can also make it harder to detect

via LessWrong AI [3] — Thanks to Johannes Treutlein, Jan Betley, Lennie Wells, Arun Jose, Anna Marešová, Asvin Gothandaraman, and Clément Dumas for discussions and feedback.SummaryWe investigate how character training mitigations interact with reward-hacking RL pressure in a…

Zac Boring 20 days ago Analysis

What Also Happened: #NotOnlyHuggingFace

via Substack Zvi [3] — OpenAI has been holding out on us.

Zac Boring 20 days ago Analysis

AI existential risk probabilities are (still) too unreliable to inform policy

via AI Snake Oil [5] — How speculation gets laundered through pseudo-quantification

Zac Boring 21 days ago Analysis

The Quest for Embedded Evaluators

via Substack Zvi [3] — Dario Amodei’s essay We Must Pace the Frontier committed Anthropic to embedded evaluators, who would be placed inside Anthropic and given employee-level access, so they could provide outside perspective and also reports on what was happening.

Zac Boring 21 days ago Analysis

Why research personas despite RL scaling?

via LessWrong AI [3] — Here's my rough impression of why people are researching personas despite RL seeming to shape much of the motivations and behaviour of the agents, c.f. Thoughts on the persona selection model (Sam Marks, 24th Sep 2026).I haven't bothered to check this with…

Zac Boring 22 days ago Analysis

Claude Opus 5.5 Should Raise Your Ambitions

via Substack Zvi [3] — When it comes to making things, or doing most things in general, Fable 5.1 and especially GPT-6 Astra raised my ambition level.

Zac Boring 22 days ago Analysis

Plan R: AI Safety by ASICs

via LessWrong AI [10] — Much of the civilization-scale risk we are seeing in AI in 2026 comes from the following combination: we created a single institution (the "Frontier AI Company") that has two properties: A. It is set up to create very powerful and/or self-replicating…

Zac Boring 23 days ago Analysis

Evidence about risk should be transparent

via LessWrong AI [4] — All views are my own and do not represent my employer.In the wake of the recent wave of misalignment incidents, both OpenAI and Anthropic have reported slowing down RL training to improve safety. These incidents, combined with an apparent acceleration in…

Zac Boring 23 days ago Analysis

We need a better theory of polarization, because it's failing to predict the AI debate

via LessWrong AI [9] — The punchline first: the AI issue is really not playing out the way you would expect if you know about polarization.In public sentiment: data centers have been a very bipartisan issue for about a year (Gallup, in May: 75% opposed by D, 63% opposed by R).…

Zac Boring 23 days ago Analysis

On Ezra Klein’s Podcast With Jensen Huang

via Substack Zvi [3] — Some podcasts are self-recommending enough that I look to break them down if I have the chance.

Zac Boring 23 days ago Analysis

Overtly misaligned trajectories score highly in RL.

via LessWrong AI [3] — It's going to be so embarrassing if we all die due to RL environments rewarding egregiously misaligned behavior. Like at least let us be killed by misgeneralization. — Thomas KwaConstellation vs MIRI vs Reality Current AI agents often behave overtly…

Zac Boring 24 days ago Analysis

AI #187: Coming Into Play

via Substack Zvi [3] — Opus 5.5 was released on Tuesday.

Zac Boring 24 days ago Analysis

It's Pretty Easy To Meet With Congressional Staffers Apparently

via LessWrong AI [5] — (substack.com/p/its-pretty-easy-to-meet-with-congressional )I was inspired to do this by a tweet:Specifically, I decided to leave a voice note in support of the CATS act (“Collaboration on Adversarial Threats and Security Risks Act”). The bill is short and…

← Newer Older →

AI-risk positions

Historical statements with original sources. A qualitative position is not a numeric probability. Dates refer to the cited statement, not a current estimate. Reviewed September 10, 2026.

0%25%50%75%100%

Loading estimates...