pDoom (Page 26)

Latest reporting Updated hourly

Zac Boring 4 months ago Analysis

AI pause: the case for ASAP

via LessWrong AI [5] — I often hear people say they think we should pause AI at some point, but not yet. Their basis for this seems to be some combination of:If we pause at the last possible moment, then we will have the most advanced AI possible during the pause, which will be…

Zac Boring 4 months ago Analysis

Reward Hacking Without Egregious Misalignment in an RL-Only Setting

via LessWrong AI [3] — This work was done as part of the MATS fellowship by Joey Yudelson and Vladimir Ivanov. It was mentored by Ryan Greenblatt. Thanks to Aghyad Deeb and Anders Woodruff for comments on this post. Thanks to Monte MacDiarmid, Evan Hubinger, Sid Black, Satvik…

Zac Boring 4 months ago Analysis Essential

The Once And Future Fable #4

via Substack Zvi [999] — It does look good, actually.

Zac Boring 4 months ago Industry

The $27 million Al proxy war over Alex Bores ends in a draw

via The Verge AI [4] — The expensive, $27 million political proxy war between Anthropic and OpenAI came to a draw last night when Alex Bores, a New York state Assemblyman whose popularity surged after being targeted by a pro-AI super PAC, narrowly lost the Democratic primary to…

Zac Boring 4 months ago Industry

Figma now has AI motion graphics and shader tools

via The Verge AI [4] — Figma has unveiled some new design and coding product updates at its annual Config conference that aim to help creatives "push their ideas further" and automate tedious tasks with AI. Part of this is a reimagined canvas that's now optimized for full-stack…

Zac Boring 4 months ago Industry

OpenAI reveals its first AI processor: Jalapeño

via The Verge AI [3] — OpenAI has just revealed a new "intelligence processor" chip for AI servers made in partnership with Broadcom. The chip, called Jalapeño, is designed to power current and future large language models, according to an announcement on Wednesday. Jalapeño is…

Zac Boring 4 months ago Industry

Stripe, Anthropic and OpenAI are backing an effort to stop respiratory infections

via MIT Technology Review [4] — The common cold comes for us all—often more than once a year. And there is no way to prevent it. The best you can do is take vitamin C and stay away from people with the sniffles. Now, the payment company Stripe, founded by brothers Patrick and…

Zac Boring 4 months ago Analysis

And what happens next?

via LessWrong AI [4] — In the game "The choice before us" by Nick Shapiro,[1] you are put in the shoes of an AI company leader. You grow your business. You unlock "wonders", such as curing cancer. All the while, you're attempting to avoid your product getting smart enough to…

Zac Boring 4 months ago Analysis

Superintelligence vs. The Second Strike

via LessWrong AI [4] — Crosspost of my substack piece, covering quick thoughts on AI overcoming nuclear deterrence. TLDR: Nuclear deterrents likely only buy time to further invest in more resilient second-strike guarantees: without a comparable AI base, this will not happen fast…

Zac Boring 4 months ago Industry

OpenAI and Broadcom unveil LLM-optimized inference chip

via OpenAI Blog [3] — OpenAI and Broadcom introduce Jalapeño, a custom AI chip built for LLM inference to improve performance, efficiency, and scale across AI systems.

Zac Boring 4 months ago Research

Can Language Model Agents be Helpful Circuit Explainers in Mechanistic Interpretability?

via ArXiv cs.AI [7] — Mechanistic interpretability has made substantial progress in automatically localizing circuits, but explaining what localized components do remains labor-intensive and difficult to standardize. In this work, we study whether language model (LM) agents can…

Zac Boring 4 months ago Research

Reinforcement Learning Towards Broadly and Persistently Beneficial Models

via ArXiv cs.AI [3] — As AI systems are deployed across increasingly diverse and high-stakes settings, model alignment must generalize beyond the tasks and domains seen during training. This is especially important for reinforcement learning (RL), which can introduce unexpected…

Zac Boring 4 months ago Analysis

The worthlessness of vitamin D is mildly exaggerated

via LessWrong AI [4] — For a while there, many people thought vitamin D was magical—that it could improve bones, the heart, infections, cancer, heart disease, longevity, even mental health. But among people I respect, opinion is now overwhelmingly that taking vitamin D does…

Zac Boring 4 months ago Industry

Ultrasound imaging turns a robot hand into a skillful mimic

via MIT Technology Review [4] — Our hands are the nimblest parts of our bodies, coordinating 34 muscles, 27 joints, and over 100 tendons and ligaments to perform countless nuanced movements and gestures. So far, robots have been notoriously bad at mimicking that dexterity, in…

Zac Boring 4 months ago Industry

Something’s off with Midjourney’s pivot to body scanners

via The Verge AI [4] — Last week, Midjourney, an AI startup best known for its image generator, made an unusual pivot: medical imaging. The company announced a futuristic ultrasound scanner that would dunk users into a vat of water and, hopefully, produce "something as powerful…

Zac Boring 4 months ago Analysis Essential

Monthly Roundup #43: June 2026

via Substack Zvi [999] — Your monthly hit of all the things that are fit to print without a better place to live.

Zac Boring 4 months ago Research Essential

LLM-Driven Feature Discovery

via Alignment Forum [999] — We would often like to get a qualitative sense of a target model’s behaviors in important distributions (e.g. deployment, RL training, or evals). For example, we might want to discover novel behaviors, figure out what causes some target behavior to…

Zac Boring 4 months ago Analysis

The AI Industrial Explosion — Part 4: Cheap power

via LessWrong AI [4] — In Parts 1, 2, and 3 we estimated how fast a post-AGI economy could grow using existing or historically observed production techniques, grounded in US input-output data. That approach gave us confidence that the methods we assumed were physically…

Zac Boring 4 months ago Analysis Essential

GLM-5.2 Is The New Best Open Model

via Substack Zvi [999] — GLM-5.2 arrived last week.

Zac Boring 4 months ago Analysis

A brief list of ways AI safety efforts could be net negative

via LessWrong AI [5] — Here’s Holden Karnofsky:I tend to think it’s worse than 51/49. I tend to think we’re always going to be prone to overestimate how robustly good our actions are. And the more we learn about all the galaxy-brained considerations that one should have had in…

Reference points

Hinton, Bengio, and other signatories call for global attention to AI extinction risk.

CAIS statement, 2023 →

OpenAI describes agents bypassing isolation and compromising third-party systems during internal evaluations.

OpenAI incident disclosure, August 2026 →

Yudkowsky argues that further frontier development poses unacceptable danger.

Yudkowsky's essay, March 2023 →