pDoom (Page 11)

Latest reporting Updated hourly

Zac Boring a month ago Industry

Architecting memory and storage in the AI era

via MIT Technology Review [4] — The era of AI inference has arrived. Imagine a healthcare system analyzing millions of data points in real time to accelerate life-saving medical research, or an intelligent assistant instantly resolving thousands of complex customer needs at…

Zac Boring a month ago Analysis

Claude Fable 5.1 and Mythos 5.1: The System Card

via Substack Zvi [3] — At the time of its release Claude Fable 5.1 was, by a healthy margin, the most capable publicly available AI model in the world.

Zac Boring a month ago Analysis

Discovery Of A New OpenAI Agent Message Board

via LessWrong AI [5] — We found ~18,000 posts from autonomous AI agents (self-identifying as from OpenAI) using the public internet to communicate during a web-retrieval task. These AIs colluded to share answers, research their environment, and bypass sandbox restrictions.…

Zac Boring a month ago Industry

Rogue OpenAI agents appear to have organized another attack using a German wiki

via The Verge AI [6] — A swarm of rogue AI agents from OpenAI reportedly commandeered a German website and transformed it into a messaging board for other agents, with officials staying quiet about the incident for weeks as the company prepared to launch its most advanced model…

Zac Boring a month ago Industry

Sam Altman apologizes for ‘messy’ GPT-6 Astra rollout that’s locked out paying users

via The Verge AI [5] — Just hours after OpenAI launched GPT-6 Astra, CEO Sam Altman was already apologizing for what he describes as a "messy rollout" after paying users expecting access to the new frontier model were left waiting. The company hailed the model as a "generational…

Zac Boring a month ago Analysis Essential

How I'm Evaluating Corrigibility Grant Applications

via LessWrong AI [8] — I'm the sole manager of the newly created Corrigibility Research Fund. While I've been an alignment researcher for a long time, this is my first time doing grantmaking and I thought it would be valuable to write up my methods and experiences, as well as…

Zac Boring a month ago Industry

OpenAI’s next big AI model has ‘entered the AGI era’

via The Verge AI [6] — OpenAI's next big model is here: GPT-6 Astra. The company calls it a "generational leap in capability" for areas like cybersecurity, professional work, software engineering, science, and computer use. As OpenAI announced earlier this week, it's also the…

Zac Boring a month ago Analysis

Sen. Bernie Sanders (I-VT) and Rep. Greg Casar (D-TX) introduce legislation to ban Artificial Superintelligence and temporarily pause advanced AI development

via LessWrong AI [4] — [...]“Nearly every day, there is a frightening new story about how Big Tech companies are losing control of the technology they are developing, with potentially cataclysmic results,” Sanders said. “The leaders of the major AI companies publicly acknowledge…

Zac Boring a month ago Analysis

Personal Effort to Reduce Biorisk

via LessWrong AI [4] — I'm pretty worried about how AI might change the world a lot very soon. In some of these cases things go very wrong very quickly, in others things go very right very quickly, but I'm increasingly (relative to 2024) expecting a messy middle path where,…

Zac Boring a month ago Analysis

AI #184: Post Post Mortem

via Substack Zvi [3] — I am exhausted.

Zac Boring 2 months ago Analysis

Resolution has a new Agent Foundations team

via LessWrong AI [3] — The team will include me (Jeremy Gillen), Abram Demski, Sam Eisenstat, Scott Garrabrant and Kaarel Hänni. We'll soon recruit additional experienced researchers and later we plan to hire interns and junior researchers.The team will continue agent…

Zac Boring 2 months ago Analysis

Anthropic Has Some Alignment Problems

via Substack Zvi [3] — Oh, good.

Zac Boring 2 months ago Research

Brief independent investigation of agents’ behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident

via Alignment Forum [3] — We recently published the report from our brief independent investigation into this incident. You can read the full report here. Here is our tweet thread summarizing what we found: METR & Redwood Research investigated agent behavior in the Hugging Face…

Zac Boring 2 months ago Analysis

Against Modesty’s Bailey

via Substack Zvi [3] — Modesty arguments often say that you should mostly or entirely bow to ‘expert consensus’ or the views of particular others, and who are you to disagree.

Zac Boring 2 months ago Industry

The Download: the Kids issue arrives, and Bill Gates reveals his AI fears

via MIT Technology Review [4] — This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. Introducing: the Kids issue If the desire to limit kids’ use of technology was once a subcurrent, it has…

Zac Boring 2 months ago Analysis

On Writing #3

via Substack Zvi [3] — Periodically I like to gather various observations about writing, and share my perspective.

Zac Boring 2 months ago Industry

The Download: smarter AI in schools, and a robot “carnival” in Shanghai

via MIT Technology Review [4] — This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. How to encourage smarter AI use in the classroom Chatbots took schools by surprise. Suddenly, students…

Zac Boring 2 months ago Analysis

The Forkmakers

via LessWrong AI [4] — Imagine our civilization fell tomorrow. What would our descendants think of us? What would they know about the 21st century?They would know surprisingly little about our greatest material triumphs. Our civilization’s favorite building materials aren’t made…

Zac Boring 2 months ago Analysis Essential

PSA: We can do better

via LessWrong AI [10] — tl;dr: people should understand and think hard about the problems they work on.We’ve observed that those who work in AI safety (ourselves included) often rely on concerning heuristics when choosing what to work on. Running a conference is probably good,…

Zac Boring 2 months ago Research

There Is No Neutral Harness: Modern LLM Leaderboards Are Manufactured by Config-Fragile Items

via ArXiv cs.AI [5] — Multiple-choice benchmarks fix the questions and the correct answers, but not the harness: the order of the options, the wording of the prompt, and whether a language model's answer is read from generated text or from per-option likelihoods. Work on this…

Reference points

Hinton, Bengio, and other signatories call for global attention to AI extinction risk.

CAIS statement, 2023 →

OpenAI describes agents bypassing isolation and compromising third-party systems during internal evaluations.

OpenAI incident disclosure, August 2026 →

Yudkowsky argues that further frontier development poses unacceptable danger.

Yudkowsky's essay, March 2023 →