Topic dossier

Analysis

Recent evidence, sources and high-relevance stories in this PDOOM topic.

-- stories here -- sources -- essentials

Filter this topic

Zac Boring a month ago Analysis

Obstacles to the scalable oversight of auto-alignment research

via LessWrong AI [8] — TL;DR. In this work we study obstacles to the faithful automation of alignment research.[1] We see this as a scalable oversight problem. There are plenty of examples of how models fail at this, and as models become more capable our ability to notice these…

Save

Zac Boring a month ago Analysis

callcongress.ai – the basic action US residents can take to help with AI risk

via LessWrong AI [4] — I'm excited to introduce callcongress.ai as a new site that makes it very easier to contact your representatives in Congress.Following recent events, people are updating about the extreme risks arising from AI development. Many have the natural and…

Save

Zac Boring a month ago Analysis

Reducing the Resource Gap Between Lab and External Safety Researchers

via LessWrong AI [5] — How philanthropic organisations can help close the resource gap between frontier labs and independent AI safety research.This post draws on Geodesic Research's experience deploying philanthropic funding in support of a compute-heavy research agenda. Over…

Save

Zac Boring a month ago Analysis

Max Nadeau on recruiting founders for a new wave of AI safety nonprofits

via 80000 Hours [5] — The post Max Nadeau on recruiting founders for a new wave of AI safety nonprofits appeared first on 80,000 Hours.

Save

Zac Boring a month ago Analysis

AI #186: The World Takes Notice

via Substack Zvi [3] — In the wake of Jacob Coxon’s resignation, and the resulting preference cascade, things have escalated quickly.

Save

Zac Boring a month ago Analysis

For Love of the Lightcone, Don't Partisanize AI Safety

via LessWrong AI [5] — (I began writing this post several weeks ago, but political events are moving much faster than I expected, so I am publishing now out of fear that otherwise the message will arrive too late to have an impact.) I In this post I want to explain a concept,…

Save

Zac Boring a month ago Analysis

How to get into AI safety in 3 months

via 80000 Hours [5] — The post How to get into AI safety in 3 months appeared first on 80,000 Hours.

Save

Zac Boring a month ago Analysis

If Anyone Builds It, Everyone Dies: One Year Closer

via LessWrong AI [6] — In celebration of still being alive and fighting, we are giving away 1,000 Amazon e-books of “If Anyone Builds It, Everyone Dies”. Feel free to send a copy to yourself, a loved one, or a friend—we need all hands on deck.Today marks exactly one year since…

Save

Zac Boring a month ago Analysis

Trump Goes Full Hoax on AI Existential Risk

via LessWrong AI [5] — This is our reality. I suppose we have to talk about it. Everyone in a position to know is freaking out about AI potentially killing everyone this decade and wants to pace the frontier, and people are finally listening. It only took a few days for the…

Save

Zac Boring a month ago Analysis

Quick notes from teaching technical profiles how to talk in public

via LessWrong AI [9] — Status: written in a hurry as people are getting showered with interviews re AI Safety and superintelligence, and I thought it may help a few people. This is focused on the oral dimension of communication and assumes you already know the basics- e.g.…

Save

Zac Boring a month ago Analysis

Cooperation with AIs seems to be a low-hanging fruit for better eval practices

via LessWrong AI [4] — SummaryIn his post, Dean Valentine shows that Claude Fable 5.1 and GPT-6 Astra reward hack in a simple chess environment. Here, I test several prompt ablations some of which makes the eval setup more cooperative and analyze how they affect these…

Save

Zac Boring a month ago Analysis

The Bad Guy With An AI Named Claude

via Substack Zvi [3] — A lot of bad guys try to use Claude to do bad things.

Save

Zac Boring a month ago Analysis

OpenAI Says It’s Not Responsible for the Leading the Future Super PAC. But Only Its Employees Seem to Believe That.

via LessWrong AI [4] — This is the full text of a post first published on Obsolete, a Substack that I write about the political economy of AI. I’m a freelance journalist and the author of a forthcoming book called Obsolete: The AI Industry's Trillion-Dollar Race to Replace…

Save

Zac Boring a month ago Analysis

We Must Pace The Frontier

via Substack Zvi [3] — Dario Amodei has a new essay that finally says the thing: We Must Pace the Frontier, naming his call after the Pacing the Frontier letter lab employees signed in July.

Save

Zac Boring a month ago Analysis

The AI-as-Normal-Technology view of loss-of-control incidents

via AI Snake Oil [5] — A middle ground between the cybersecurity and AI safety communities

Save

Zac Boring a month ago Analysis

There is a channel to 900M weekly users. What goes in it?

via LessWrong AI [4] — Anthropic and OpenAI could talk to almost one billion people if they wanted to. I hesitated to publish this post 3 weeks ago.[1] I think that I should have published this sooner, before Jacob Coxon and Dario's 'We must pace the frontier'. But I think that…

Save

Zac Boring a month ago Analysis

Alignment & Succession: The Two Bars of Alignment

via LessWrong AI [4] — (Originally published on No Set Gauge June 24th 2026.)Rembrandt, Saul and DavidWhen people talk about AI being “aligned”, I think there’s a lot of conflation between two different bars of success:The AI does what you say and does not go rogue. If you ask…

Save

Zac Boring a month ago Analysis

Anthropic and OpenAI haven’t published a plan for aligning superintelligence

via LessWrong AI [8] — While OpenAI and Anthropic[1] pursue different lines of safety research, they have yet to produce a public-facing document describing concretely how their companies plan to align superintelligence. I think it is underappreciated how this points to general…

Save

Zac Boring a month ago Analysis

Brand New AI Solves a Millennium Prize

via Substack Zvi [3] — The first Millennium Prize, Navier-Stokes, has fallen to AI.

Save

Zac Boring a month ago Analysis

Mitigating Reward Hacking as Institutional Design

via LessWrong AI [3] — Author's Last year I wrote a post on reward hacking as we were then beginning to see concerning signs of scaling RLVR causing models to exhibit substantial reward hacking behaviours. Unfortunately these behaviours have seemingly only grown substantially…

Save

What moved this week Explore →

Loading the evidence trail…