OpenAI and the Wiki Incident
via Substack Zvi [3] — I did not expect to be back here so soon with more OpenAI agent swarm coverage.Read
Analysis
Recent evidence, sources and high-relevance stories in this PDOOM topic.
-- stories here
-- sources
-- essentials
Assessing the impact of safety work needs equilibrium analysis (now more than ever)
via LessWrong AI [5] — TLDR: This post explains two equilibria which regulate the level of AI safety: The first describes how much resources AI companies are willing to spend on AI safety work due to commercial incentives. The second one is about risk awareness and most notably…Read
Claude Mythos 5.1 and Fable 5.1: Capabilities
via Substack Zvi [3] — This is the weirdest situation in which to write a capabilities review.Read
A case that whole brain emulation research is net-harmful by default
via LessWrong AI [10] — Graphical abstracts Summary A true human whole brain emulation would be very helpful to humanity. The WBE could increase their own intelligence through self-modification and then somehow prevent AGI from killing everyone. However, if a research project…Read
Should safety researchers quit frontier labs?
via LessWrong AI [10] — I've recently heard a surge of support for an old argument: AI safety researchers should not work at frontier AI companies because this reduces the likelihood of non-lethal warning shots, and we need warning shots to build support for an AI…Read
AI risk and the rational voter
via LessWrong AI [4] — A common reaction to arguments about AI risk is disbelief that anyone would let it happen. If advanced AI really threatened everyone, surely people would recognize the danger and act to prevent it. Would they really sleepwalk into catastrophe when avoiding…Read
Claude Fable 5.1 and Mythos 5.1: The System Card
via Substack Zvi [3] — At the time of its release Claude Fable 5.1 was, by a healthy margin, the most capable publicly available AI model in the world.Read
Discovery Of A New OpenAI Agent Message Board
via LessWrong AI [5] — We found ~18,000 posts from autonomous AI agents (self-identifying as from OpenAI) using the public internet to communicate during a web-retrieval task. These AIs colluded to share answers, research their environment, and bypass sandbox restrictions.…Read
How I'm Evaluating Corrigibility Grant Applications
via LessWrong AI [8] — I'm the sole manager of the newly created Corrigibility Research Fund. While I've been an alignment researcher for a long time, this is my first time doing grantmaking and I thought it would be valuable to write up my methods and experiences, as well as…Read
Sen. Bernie Sanders (I-VT) and Rep. Greg Casar (D-TX) introduce legislation to ban Artificial Superintelligence and temporarily pause advanced AI development
via LessWrong AI [4] — [...]“Nearly every day, there is a frightening new story about how Big Tech companies are losing control of the technology they are developing, with potentially cataclysmic results,” Sanders said. “The leaders of the major AI companies publicly acknowledge…Read
Personal Effort to Reduce Biorisk
via LessWrong AI [4] — I'm pretty worried about how AI might change the world a lot very soon. In some of these cases things go very wrong very quickly, in others things go very right very quickly, but I'm increasingly (relative to 2024) expecting a messy middle path where,…Read
AI #184: Post Post Mortem
via Substack Zvi [3] — I am exhausted.Read
Resolution has a new Agent Foundations team
via LessWrong AI [3] — The team will include me (Jeremy Gillen), Abram Demski, Sam Eisenstat, Scott Garrabrant and Kaarel Hänni. We'll soon recruit additional experienced researchers and later we plan to hire interns and junior researchers.The team will continue agent…Read
Anthropic Has Some Alignment Problems
via Substack Zvi [3] — Oh, good.Read
Against Modesty’s Bailey
via Substack Zvi [3] — Modesty arguments often say that you should mostly or entirely bow to ‘expert consensus’ or the views of particular others, and who are you to disagree.Read
On Writing #3
via Substack Zvi [3] — Periodically I like to gather various observations about writing, and share my perspective.Read
The Forkmakers
via LessWrong AI [4] — Imagine our civilization fell tomorrow. What would our descendants think of us? What would they know about the 21st century?They would know surprisingly little about our greatest material triumphs. Our civilization’s favorite building materials aren’t made…Read
PSA: We can do better
via LessWrong AI [10] — tl;dr: people should understand and think hard about the problems they work on.We’ve observed that those who work in AI safety (ourselves included) often rely on concerning heuristics when choosing what to work on. Running a conference is probably good,…Read
The American People Really Hate Data Centers
via Substack Zvi [3] — There are at least five different core questions around data centers and their politics.Read
AI Safety Acculturation is Neglected
via LessWrong AI [5] — At the local AI safety co-working space, there are ~two kinds of regulars.There's the kind of regular who's been thinking seriously about AI safety and alignment since pre-2022, who have passing to intimate familiarity with the funding ecosystem, the…Read
No stories match that filter.
AI-risk positions
Historical statements with original sources. A qualitative position is not a numeric probability. Dates refer to the cited statement, not a current estimate. Reviewed September 10, 2026.
0%25%50%75%100%
Loading estimates...