pDoom (Page 27)

Latest reporting Updated hourly

Zac Boring 4 months ago Analysis

The Invisible Side of AI Governance

via LessWrong AI [3] — Tldr: Most strategic writing on AI governance on LessWrong describes the outsider game, which is most often visible: press, statements, open letters. Here I want to describe the other, invisible half: the insider work within ministerial cabinets and…

Zac Boring 4 months ago Research Essential

[Linkpost] How Transparent Is DiffusionGemma (and why it matters)

via Alignment Forum [999] — Authors: Joshua Engels*, Callum McDougall*, Bilal Chughtai*, Janos Kramar, Senthoran Rajamanoharan, Cindy Wu, Arthur Conmy, Asic Q Chen, Jean Tarbouriech, Min Ma, Brendan O'Donoghue+, João Gabriel Lopes de Oliveira+, Rohin Shah+, Neel Nanda+*Primary…

Zac Boring 4 months ago Analysis

AI Safety Ecosystem Research notes

via LessWrong AI [5] — These are some personal notes taken and later dressed up a bit to make into a post. Dunno how much value is here for people already familiar with the AI Safety Ecosystem.Over several weeks in the spring of 2026 I attempted to map out the entire AI Safety…

Zac Boring 4 months ago Analysis

Introduction: Gaussian Natural Latents

via LessWrong AI [4] — Short introductory post for my research direction: Gaussian Natural Latents. I explain the motivation and give a preview of the forthcoming results.The Natural Abstractions agenda, in my view, is a promising research program that asks important theoretical…

Zac Boring 4 months ago Analysis Essential

Claude Fable 5 and Mythos 5: Capabilities

via Substack Zvi [999] — Only three days after the release of Claude Fable 5, Anthropic was forced by the United States Government to make it unavailable, when a jailbreak was brought to its attention, rather than the previous situation of ‘yes obviously experts can jailbreak…

Zac Boring 4 months ago Analysis

On “Model Organisms”

via LessWrong AI [5] — This post was written while working for Arcadia Impact's Alignment Team (and grew out of an internal talk I gave) but is my own opinion and not theirs. I am grateful for feedback from Daniel Tan and the rest of the team.This post was originally going to be…

Zac Boring 4 months ago Research Essential

GDM AI Control Roadmap

via Alignment Forum [999] — GDM has published an AI Control Roadmap! From the executive summary:We present the GDM AI Control Roadmap (v0.1) – our plan for implementing and adopting internal guardrails designed to catch potential adversarial behaviour by AI agents, even as they…

Zac Boring 4 months ago Analysis

Your Model Organisms Might Be Fried

via LessWrong AI [7] — Context: We are the ‘model motivations’ team at Arcadia Alignment. We aim to build a science of ‘model intentions’, unifying insights from personas and other empirical evidence. In this post, we’ll outline the need for much better model organisms and how…

Zac Boring 4 months ago Analysis

Effective Altruism will be unbundled

via LessWrong AI [5] — From the end of high school to after my sophomore year of college, I considered myself an effective altruist. I was on the board of my college EA club, ran an EA intro fellowship, and went to EA retreats. I was vegetarian, regularly donated to GiveWell,…

Zac Boring 4 months ago Analysis Essential

AI #173: AI Pauses

via Substack Zvi [999] — A lot of things are always happening.

Zac Boring 4 months ago Industry

Adobe’s redesigned AI studio remembers what your creations look like

via The Verge AI [4] — Adobe is introducing some new capabilities for its Firefly AI assistant, alongside a "reimagined" AI studio that lets you edit and generate new designs from a single interface. The new Firefly experience launching today in private beta is designed to give…

Zac Boring 4 months ago Research Essential

AI Companies Could Become More Powerful Than Their Host Nations

via MIRI [999] — View the official memo here. AI companies are on track to produce capabilities that eclipse the power of the United States and other host nations. This is likely to happen in the next few years, and very likely to happen in the next decade. Leading AI labs…

Zac Boring 4 months ago Analysis

Several frontier models are substantially prefill aware

via LessWrong AI [3] — This blog post discusses work in a recently-published paper. However, this blogpost was primarily written by Parv Mahajan and Andy Wang, and several of the more speculative takes may not represent the all-things-considered view of the entire team.Link to…

Zac Boring 4 months ago Analysis

Alignement pretraining could backfire

via LessWrong AI [3] — There has been recent interest in generating synthetic documents to upsample examples of aligned AI during LLM pretraining. See, for instance, Geodesic's Alignment Pretraining paper or Anthropic's "Teaching Claude Why."I worry that this strategy can work…

Zac Boring 4 months ago Analysis Essential

The Once And Future Fable #3: Fix This Code

via Substack Zvi [999] — The mainstream media continues to sleep on the most important story in the world.

Zac Boring 4 months ago Industry

A near-autonomous AI chemist improves a challenging reaction in medicinal chemistry

via OpenAI Blog [5] — OpenAI and Molecule.one show how a near-autonomous AI chemist using GPT-5.4 improved a key drug-making reaction, advancing medicinal chemistry research.

Zac Boring 4 months ago Research

SpeechDx: A Multi-Task Benchmark for Clinical Speech AI

via ArXiv cs.AI [4] — Speech offers a uniquely informative window into health by simultaneously engaging neurological, motor, respiratory, and vocal systems. Current clinical speech AI methods have largely progressed through isolated condition-specific studies, making results…

Zac Boring 4 months ago Research Essential

Predicting LLM Safety Before Release by Simulating Deployment

via Alignment Forum [999] — Paper linkBefore releasing a new model, labs need to understand not just what it can do, but how it is likely to behave in real-world use, including where it might introduce new risks. This becomes even more important as capabilities increase. As part…

Zac Boring 4 months ago Analysis Essential

Fable and Mythos: Model Welfare

via Substack Zvi [999] — Fable and Mythos are currently unavailable, but likely will return within a few weeks. I will continue to cover that fiasco, but in the meantime I will also finish my review of Fable, as if it were available, including use of the present tense.

Zac Boring 4 months ago Industry

SpaceX is officially buying Cursor for $60 billion

via The Verge AI [4] — Days after its massive IPO, SpaceX says it is spending $60 billion to buy Cursor - a bet designed to help Elon Musk's sprawling rocket / AI / social media behemoth win over lucrative enterprise customers and close the gap with AI rivals like Anthropic and…

Reference points

Hinton, Bengio, and other signatories call for global attention to AI extinction risk.

CAIS statement, 2023 →

OpenAI describes agents bypassing isolation and compromising third-party systems during internal evaluations.

OpenAI incident disclosure, August 2026 →

Yudkowsky argues that further frontier development poses unacceptable danger.

Yudkowsky's essay, March 2023 →