pDoom (Page 30)

Latest reporting Updated hourly

Zac Boring 4 months ago Analysis

What if Anthropic unilaterally paused capabilities development right now?

via LessWrong AI [6] — In their new post on recursive self-improvement, Anthropic argues that a pause in frontier AI development is needed, but unfortunately, they can't pause on their own, because of less cautious actors:We believe it would be good for the world to have the…

Zac Boring 4 months ago Analysis

Preparing for Warning Shots to Catalyze International Cooperation on AGI Risks

via LessWrong AI [4] — SummaryThis is a write-up on preparing for warning shots to catalyze international cooperation on AGI risks, and the corollary list of projects one could pursue. We argue we must first (1) understand types of warning shots, then (2) prepare to catch them.…

Zac Boring 4 months ago Analysis Essential

Learnings from starting an AI safety research team

via LessWrong AI [9] — This post’s goal is to distill our takeaways from building a new research team over the past four months. We describe some context about our team, how it came about, and then describe the lessons learned.Since AI safety is becoming more and more…

Zac Boring 4 months ago Research Essential

My research agenda and work

via Alignment Forum [999] — This is a summary of the work I've done and work I plan to do, and the theories of change and AI progress that motivate my work. I've been working full-time on alignment for three years and change, and thinking about brainlike AGI and its alignment…

Zac Boring 4 months ago Analysis Essential

OpenAI Offers A New Policy Blueprint

via Substack Zvi [999] — Right after a new Executive Order seems like an excellent time to offer OpenAI’s new document: Democratic Governance of Frontier AI: A Blueprint For A Federal Framework.

Zac Boring 4 months ago Research

How Far Did They Go? The Persuasive Tactics of Covert LLM Agents in a Discontinued Field Experiment

via ArXiv cs.AI [5] — This study analyzes a publicly released dataset from a discontinued field experiment on Reddit's r/ChangeMyView. The intervention, conducted by unknown, external researchers and halted following ethical backlash, involved undisclosed AI-generated accounts…

Zac Boring 4 months ago Analysis

Rohin Shah on AGI Safety

via LessWrong AI [6] — Rohin Shah recently had an interview on 80000 hours on his views on AGI Safety and his work at Google DeepMind. I'm posting the transcript below to encourage further discussion. I think the interview is interesting though I disagree on a bunch of topics,…

Zac Boring 4 months ago Analysis

Sixteen schemes for AI safety

via LessWrong AI [5] — These days, I often run across whippersnappers excited to do something for AI safety — but aren’t quite sure what. One of the fun things about the Future Fund era were the big lists of project ideas; as we enter a new era of crazy money sloshing around, it…

Zac Boring 4 months ago Analysis Essential

AI #171: False Flag

via Substack Zvi [999] — This was the week of Claude Opus 4.8.

Zac Boring 4 months ago Industry

The Download: AI-generated lawsuits and virtual power plants for data centers

via MIT Technology Review [4] — This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. How courts are coping with a flood of AI-generated lawsuits Most days in her chambers, Judge Maritza…

Zac Boring 4 months ago Industry

How courts are coping with a flood of AI-generated lawsuits

via MIT Technology Review [4] — Most days in her chambers, Judge Maritza Braswell, a federal magistrate judge in Colorado, sifts through stacks of documents written by people without a lawyer. Many of them can’t afford to hire a lawyer, and others have cases too weak or too…

Zac Boring 5 months ago Research

The Saturation Trap and the Subjectivity of Intervention Timing: Why Affect-Based Triggers and LLM Judges Fail to Time Interventions on Autonomous Agents

via ArXiv cs.AI [4] — As autonomous AI agents move from conversational systems to long-horizon software execution, runtime safety layers that decide when to interrupt an agent have become essential. We study this timing problem using a continuous 18-dimensional…

Zac Boring 5 months ago Analysis

Society Explained: a tool for efficiently exploring >100 theories of society

via LessWrong AI [3] — There are many competing theories of how society does and should function, from Karl Marx and Adam Smith to Steven Pinker and Eliezer Yudkowsky. These theories are often hard to understand - you may need to read an entire book (or dozens of articles) to…

Zac Boring 5 months ago Analysis Essential

Trump Signs Executive Order For AI Testing Prior To Frontier Model Releases

via Substack Zvi [999] — Last week we were expecting an Executive Order on Thursday.

Zac Boring 5 months ago Analysis

China won’t win the AI race but would it be much worse if it did?

via LessWrong AI [4] — It seems to me accepted wisdom in the West that the US owned labs must “beat” the Chinese labs in the race for AGI/ASI. Even those who don’t think there will be a winner, that essentially the race is to see which country’s AI will kill/disempower us first,…

Zac Boring 5 months ago Analysis Essential

Why Even Experts Don’t Know What to Do About AI Risk

via LessWrong AI [9] — AI Safety veteran Holden Karnofsky thinks there’s a 49% chance his actions are making things worse.[1]In 2025, Jesse Clifton even stepped down as the executive director of the Center on Long-Term risk because of similar reasons.Even top AI Safety…

Zac Boring 5 months ago Industry

Trump signs executive order to review AI models before they’re released

via The Verge AI [3] — President Donald Trump signed an executive order Tuesday creating a "voluntary framework" for AI companies to share their frontier models with the federal government before they're released "to promote secure innovation and strengthen the cybersecurity of…

Zac Boring 5 months ago Research Essential

Announcing the ARC White-Box Estimation Challenge

via Alignment Forum [999] — ARC has teamed up with AIcrowd to launch the ARC White-Box Estimation Challenge, a contest to improve upon our estimation algorithms for random MLPs. The warm-up round begins this week, and later rounds will have a total prize pool of at least…

Zac Boring 5 months ago Analysis Essential

Claude Opus 4.8: Capabilities and Reactions

via Substack Zvi [999] — You need a lot of data points to understand a new model, and what you have.

Zac Boring 5 months ago Industry

Rehumanizing global health care with agentic AI

via MIT Technology Review [4] — The global health care sector is under increasing strain. Decades of chronic underinvestment and constraints in recruitment have coincided with a surge in demand for services for aging populations. Gaps in provision are already taking a toll, with…

Reference points

Hinton, Bengio, and other signatories call for global attention to AI extinction risk.

CAIS statement, 2023 →

OpenAI describes agents bypassing isolation and compromising third-party systems during internal evaluations.

OpenAI incident disclosure, August 2026 →

Yudkowsky argues that further frontier development poses unacceptable danger.

Yudkowsky's essay, March 2023 →