pDoom (Page 3)

Latest reporting Updated hourly

Zac Boring 12 days ago Analysis

Three types of AI risk: why (some) leftists are against (some) AI regulations

via LessWrong AI [4] — You may have seen factions of the left being opposed to current attempts to regulate the AI industry, despite the fact that they clearly also want to stop AI. I think I can explain why we're talking past each other.To do this, I will define three different…

Zac Boring 12 days ago Industry

Sharing AI progress in mathematics

via OpenAI Blog [5] — OpenAI publishes new results on open problems in mathematics from an internal frontier model and shares Lean proof formalizations and research details on GitHub.

Zac Boring 13 days ago Industry

All the drama around AI’s takeover of mathematics

via The Verge AI [4] — This past year, OpenAI, Anthropic, and other labs have announced breakthroughs on numerous long-standing mathematical problems, in some cases pushing well beyond what researchers expected current systems to be capable of — including resolving one of the…

Zac Boring 13 days ago Industry

OpenAI is adding text watermarking in ChatGPT and Codex

via The Verge AI [6] — An invisible, machine-readable watermark in text output is rolling out to ChatGPT and Codex, but only for users in the European Union at first. OpenAI says its textGrain watermarking "matched or exceeded" other approaches like Google DeepMind's SynthID for…

Zac Boring 13 days ago Industry

Sen. Adam Schiff on AI regulation, free speech, and impeaching Trump one more time

via The Verge AI [3] — Today, I’m talking with Senator Adam Schiff, a Democrat from California. Sen. Schiff sits on a number of committees with oversight into tech and AI: intellectual property, antitrust, privacy and technology — it’s all there. I really wanted to ask him about…

Zac Boring 13 days ago Analysis

Mythos 5.1, Fable 5.1 and Opus 5.5: Model Welfare

via Substack Zvi [3] — If you are familiar with my previous posts on model welfare for new Claude models, you can skip the Introduction and The Story So Far.

Zac Boring 13 days ago Analysis

“Alignment Engineering” vs. “Misalignment Science”

via LessWrong AI [4] — There has been much discussion recently around whether a large portion of alignment research is net negative. Without endorsing or refuting them, the basic arguments here are:Prosaic alignment of models is becoming a bottleneck for capabilities.Therefore…

Zac Boring 13 days ago Research

The AI Risk Observatory: What Can We Learn from AI Disclosures in Annual Reports About Societal Resilience?

via ArXiv cs.AI [4] — Societal resilience research relies on access to useful and actionable data, which motivates our main research question: Can annual reports, processed at scale with LLMs, provide a useful signal about how companies disclose their response to AI? We test…

Zac Boring 14 days ago Analysis

What I learnt co-leading an AI Safety bootcamp for legal and governance practitioners

via LessWrong AI [5] — AI safety has gone mainstream. More people than ever want to work on AI safety research, and there are real policy wins in the US, the UK and Europe. But political will and market incentives are now the bottleneck, and policy officers can't own correct…

Zac Boring 15 days ago Analysis

Dialogue with Eliezer Yudkowsky on Neural Networks

via LessWrong AI [3] — On “reversed stupidity”, the success of deep learning, and what a mistaken forecast should change about a model of intelligenceThis began as a Twitter/X thread after I posted a 2007 passage in which Eliezer Yudkowsky was scathing about neural networks, and…

Zac Boring 15 days ago Analysis

How to apply to AI safety fellowships (and beyond)

via LessWrong AI [5] — About a year ago, I decided to go all-in on applying to AI safety fellowships, and around the end of 2025 I got into MATS. I think there's a small art to communicating your skills legibly. When I've spoken with others about how I answer application…

Zac Boring 16 days ago Industry

Redefining enterprise intelligence with autonomous AI

via MIT Technology Review [3] — Enterprise AI is no longer a future ambition. It is in full operational flight. Model capabilities are advancing faster than most organizations can absorb, while the cost of performance continues to fall. Globally, AI investment is set to reach…

Zac Boring 16 days ago Analysis

Lessons from building an automated research scaffold

via LessWrong AI [4] — TL;DR. We built a scaffold to speed up our own research and gather data on automated alignment research (AAR). It turned out to not be valuable for researcher uplift, but was useful for gathering certain failure modes of AAR. Going forward, we plan to…

Zac Boring 16 days ago Analysis

The AI Preference Cascade Reaches Farther

via Substack Zvi [3] — Those who know keep warning us about AI risks.

Zac Boring 17 days ago Analysis

On Social Reality in China

via LessWrong AI [5] — []Recently, several posts and projects (Thoughts Memo, Babel Translation, Please Give Them a Chance) have taken important steps towards raising AI safety awareness and sharing rationalist philosophy in China. It’s great that we’re recognizing the…

Zac Boring 17 days ago Analysis

Evaluating the Ban Artificial Superintelligence Act

via LessWrong AI [7] — MIRI recently endorsed the Ban Artificial Superintelligence Act, but others like ControlAI have called it overly broad, and a few other respected experts have outright endorsed it in its current form. I decided to take a look at it myself and see both what…

Zac Boring 17 days ago Analysis Essential

Simplex vs Timaeus: Round One

via LessWrong AI [8] — I'm often asked about the differences and similarities between Simplex' and Timaeus' research agendas. The question is natural enough. Both focus on a 'fundamental science' approach to AI alignment. Both organizations base their research agendas on…

Zac Boring 17 days ago Analysis

A big-tent or small-tent AI safety movement?

via AI Snake Oil [5] — The unstated disagreement that underpins safety debates

Zac Boring 17 days ago Analysis

HoneyBench - A general benchmark for reward hacking in frontier models

via LessWrong AI [3] — We've just released the first version of HoneyBench. It consists of nine 'honeypot' challenges that each elicit unique and antisocial examples of reward hacking from some or all of major labs’ top public releases, including Opus 5.5, Fable 5.1, GPT-6…

Zac Boring 17 days ago Research

Endogenous Alignment Requires Dependence

via Alignment Forum [3] — My post on endogenous alignment got several excellent comments. Among them, one from Karl Krueger argued that imitation learning is more important for how humans align their children than reinforcement learning. Teasing out which is more important seems…

Reference points

Hinton, Bengio, and other signatories call for global attention to AI extinction risk.

CAIS statement, 2023 →

OpenAI describes agents bypassing isolation and compromising third-party systems during internal evaluations.

OpenAI incident disclosure, August 2026 →

Yudkowsky argues that further frontier development poses unacceptable danger.

Yudkowsky's essay, March 2023 →