pDoom (Page 42)

Latest reporting Updated hourly

Zac Boring 7 months ago Industry

Microsoft’s new ‘superintelligence’ game plan is all about business

via The Verge AI [4] — Mustafa Suleyman has been preparing for his new job description for a long time. Suleyman is Microsoft's inaugural CEO of AI, but after the company underwent a large-scale restructuring in mid-March, he's handed off some duties and shifted focus to chasing…

Zac Boring 7 months ago Analysis Essential

AI #162: Visions of Mythos

via Substack Zvi [999] — Anthropic had some problem with leaks this week.

Zac Boring 7 months ago Analysis

Anthropic's Pause is the Most Expensive Alarm in Corporate History

via LessWrong AI [6] — Imagine Apple halting iPhone production because studies linked smartphones to teen suicide rates. Imagine Pfizer proactively pulling Lipitor because of internal studies showing increased cardiac risk, and not because of looming settlements or FDA…

Zac Boring 7 months ago Research Essential

My most common advice for junior researchers

via Alignment Forum [999] — Written quickly as part of the Inkhaven Fellowship. At a high level, research feedback I give to more junior research collaborators often can fall into one of three categories:Doing quick sanity checksSaying precisely what you want to sayAsking why…

Zac Boring 7 months ago Analysis Essential

Introducing LIMBO: Maintaining Optimal P(DOOM) (and a call for funding)

via LessWrong AI [12] — We are excited to publicly introduce the Laboratory for Importance-sampled Measure and Bayesian Observation (LIMBO), a small research group working at the intersection of cosmological theory, probability, and existential risk. We believe that the…

Zac Boring 7 months ago Analysis Essential

Anthropic Responsible Scaling Policy v3: A Matter of Trust

via Substack Zvi [999] — Anthropic has revised its Responsible Scaling Policy to v3.

Zac Boring 7 months ago Research Essential

Predicting When RL Training Breaks Chain-of-Thought Monitorability

via Alignment Forum [999] — Read our full paper about this topic by Max Kaufmann, David Lindner, Roland S. Zimmermann, and Rohin Shah.Overseeing AI agents by reading their intermediate reasoning “scratchpad” is a promising tool for AI safety. This approach, known as…

Zac Boring 7 months ago Research

Mimosa Framework: Toward Evolving Multi-Agent Systems for Scientific Research

via ArXiv cs.AI [6] — Current Autonomous Scientific Research (ASR) systems, despite leveraging large language models (LLMs) and agentic architectures, remain constrained by fixed workflows and toolsets that prevent adaptation to evolving tasks and environments. We introduce…

Zac Boring 7 months ago Research

Enhancing Policy Learning with World-Action Model

via ArXiv cs.AI [4] — This paper presents the World-Action Model (WAM), an action-regularized world model that jointly reasons over future visual observations and the actions that drive state transitions. Unlike conventional world models trained solely via image prediction, WAM…

Zac Boring 7 months ago Research

Towards Computational Social Dynamics of Semi-Autonomous AI Agents

via ArXiv cs.AI [3] — We present the first comprehensive study of emergent social organization among AI agents in hierarchical multi-agent systems, documenting the spontaneous formation of labor unions, criminal syndicates, and proto-nation-states within production AI…

Zac Boring 7 months ago Research Essential

Working Paper: Towards a Category-theoretic Comparative Framework for Artificial General Intelligence

via ArXiv cs.AI [8] — AGI has become the Holly Grail of AI with the promise of level intelligence and the major Tech companies around the world are investing unprecedented amounts of resources in its pursuit. Yet, there does not exist a single formal definition and only some…

Zac Boring 7 months ago Analysis Essential

Product Alignment is not Superintelligence Alignment (and we need the latter to survive)

via LessWrong AI [9] — tl;dr: progress on making Claude friendly[1] is not the same as progress on making it safe to build godlike superintelligence. solving the former does not imply we get a good future.[2] please track the difference.The term 'Alignment' was coined[3] to…

Zac Boring 7 months ago Analysis Essential

Co-Found Lens Academy With Me. (We have early users and funding)

via LessWrong AI [9] — tl;dr. Lens Academy is creating scalable superingelligence x-risk education with several USPs. Current team: Luc (full time founder, technical generalist) and several part time contributors. We have users and funding. Looking for a cofounder who's either a…

Zac Boring 7 months ago Analysis

Slack in Cells, Slack in Brains

via LessWrong AI [4] — [A veridically metaphorical explanation of why you shouldn't naïvely cram your life with local optimizations (even for noble or altruistic reasons).]TL;DR: You need Slack to be an effective agent. Slack is fragile, and it is tempting to myopically…

Zac Boring 7 months ago Industry

The Download: AI health tools and the Pentagon’s Anthropic culture war

via MIT Technology Review [4] — This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. There are more AI health tools than ever—but how well do they work? In the last few months alone, Microsoft,…

Zac Boring 7 months ago Analysis Essential

Movie Review: The AI Doc

via Substack Zvi [999] — The AI Doc: Or How I Became an Apocaloptimist is a brilliant piece of work.

Zac Boring 7 months ago Research

MediHive: A Decentralized Agent Collective for Medical Reasoning

via ArXiv cs.AI [6] — Large language models (LLMs) have revolutionized medical reasoning tasks, yet single-agent systems often falter on complex, interdisciplinary problems requiring robust handling of uncertainty and conflicting evidence. Multi-agent systems (MAS) leveraging…

Zac Boring 7 months ago Analysis

The state of AI safety in four fake graphs

via LessWrong AI [5] — Here is a quick overview of my intuitions on where we are with AI safety in early 2026:So far, we continue to see exponential improvements in capabilities. This is most visible in the famous “METR graph”, but the trend is clear in many other metrics,…

Zac Boring 7 months ago Analysis Essential

AI #161 Part 2: Every Debate on AI

via Substack Zvi [999] — AI discorce.

Zac Boring 7 months ago Analysis

(Some) Natural Emergent Misalignment from Reward Hacking in Non-Production RL

via LessWrong AI [5] — Authors: Satvik Golechha*, Sid Black*, Joseph Bloom* Equal Contribution.This work was done as part of the Model Transparency team at the UK AI Security Institute (AISI).Executive SummaryIn Natural Emergent Misalignment from Reward Hacking in Production RL…

Reference points

Hinton, Bengio, and other signatories call for global attention to AI extinction risk.

CAIS statement, 2023 →

OpenAI describes agents bypassing isolation and compromising third-party systems during internal evaluations.

OpenAI incident disclosure, August 2026 →

Yudkowsky argues that further frontier development poses unacceptable danger.

Yudkowsky's essay, March 2023 →