Zac Boring 2 months ago Analysis The American People Really Hate Data Centers via Substack Zvi [3] — There are at least five different core questions around data centers and their politics. Save Read
Zac Boring 2 months ago Analysis AI Safety Acculturation is Neglected via LessWrong AI [5] — At the local AI safety co-working space, there are ~two kinds of regulars.There's the kind of regular who's been thinking seriously about AI safety and alignment since pre-2022, who have passing to intimate familiarity with the funding ecosystem, the… Save Read
Zac Boring 2 months ago Industry How to encourage smarter AI use in the classroom via MIT Technology Review [5] — This article is from Making AI Work, MIT Technology Review’s limited-run newsletter examining how to apply LLMs across industries. To receive it in your inbox, sign up here. Chatbots took many schools by surprise upon their release a few years… Save Read
Zac Boring 2 months ago Research PrimeAgentOrchestrator: Memory-Primed Agent Spawning for Personal AI Infrastructure via ArXiv cs.AI [4] — Large language model (LLM) coding agents start each session with an empty context window, discarding accumulated knowledge from prior work. We present PrimeAgentOrchestrator (PAO), a system that spawns new instances of Claude Code -- Anthropic's… Save Read
Zac Boring 2 months ago Analysis Essential What just happened? Pragmatism and Pessimization via LessWrong AI [10] — This post is about the major role alignment researchers played in advancing the frontier of AI capabilities over the last decade, and how the distinction between “alignment research” and “capabilities research" thereby lost most of its meaning.[1] In… Save Read
Zac Boring 2 months ago Analysis Twenty Years from RSI to Takeoff: Slow Learning, Scaling Slowdown, Industrial Explosion via LessWrong AI [5] — Industrial explosion is what will make the next-model building loops (and thus learning) with LLMs 1000x faster by about 2050, if indeed the slow-learning prosaic RSI becomes AGI before the big compute buildout slowdown of 2032+ that is already starting.… Save Read
Zac Boring 2 months ago Analysis When is Unlimited Optimization Catastrophic? via LessWrong AI [4] — This post discusses research I've completed along with my colleagues Leo Cymbalista, Alfred Harwood, and Jose Faustino at Dovetail Research. Most of the ideas in this post are expanded upon in our paper which can be found on arXiv. This work was funded by… Save Read
Zac Boring 2 months ago Analysis Evaluating Explanations of LLM Behavior In The Wild with Counterfactual Experiments via LessWrong AI [4] — TL;DR: We introduce CHIVE, an agentic pipeline that discovers unexpected LLM behaviors in the wild and explains them with counterfactual prompt edits. We use the resulting data in two ways. Using it as an evaluation, we find that activation-reading… Save Read
Zac Boring 2 months ago Analysis AI Text Watermarking Is Free And Good via Substack Zvi [3] — Scott Aaronson, while working at OpenAI, largely solved AI text watermarking together with Hendrik Kirchner. Save Read
Zac Boring 2 months ago Analysis Grantmaking for AI safety via 80000 Hours [5] — The post Grantmaking for AI safety appeared first on 80,000 Hours. Save Read
Zac Boring 2 months ago Analysis When Models Identify as a Swarm via LessWrong AI [3] — tldr: the word 'swarm' is associated with emergent collective intelligence, but also stupid or destructive behaviour. LLM self identity matters, so when they call themselves a swarm we should pay attention.Since the OpenAI Hugging Face incident it has… Save Read
Zac Boring 2 months ago Analysis Essential AI #182: Pause For Reflection via Substack Zvi [999] — This was a week of quiet aftermath, an opportunity to process recent events and start to figure out the path forward. Save Read
Zac Boring 2 months ago Analysis 34% of the US public is now aware of AI xrisk, and the curve is steepening via LessWrong AI [5] — (This post is an update from a previous one here.)The Existential Risk Observatory has been interested in public awareness of AI existential risk since its inception over five years ago. We started surveying public awareness in December 2022, including by… Save Read
Zac Boring 2 months ago Analysis Essential OpenAI Takes Initial Steps To Address Its Alignment Problems via Substack Zvi [999] — OpenAI has some severe misalignment problems, and experienced total failures of its infrastructure and supervision. Save Read
Zac Boring 2 months ago Analysis RL creates split personas via LessWrong AI [4] — I describe my current view of personas in LLMs and why RL leads to egregious reward hacking in some contexts while the same models seem very aligned in other contexts. This post describes the framing/paradigm without any new experimental results.I'm quite… Save Read
Zac Boring 2 months ago Industry Essential Offering Zero Data Retention for frontier models via OpenAI Blog [10] — OpenAI reaffirms Zero Data Retention for eligible API customers and previews Private Safety Processing for advanced AI safety without compromising data privacy. Save Read
Zac Boring 2 months ago Industry OpenAI hit the brakes. Now what? via The Verge AI [4] — With a looming IPO, intense competition from Anthropic, and Chinese and open-weight rivals nipping at its heels, OpenAI has plenty of reasons to move fast. Instead, it hit the brakes. On Tuesday, the company said it had slowed the pace of some AI… Save Read
Zac Boring 2 months ago Research Essential Debate Training Reduces Reward Hacking in RLAIF via Alignment Forum [999] — Paper: Debate Training Reduces Reward Hacking in RLAIFLinkpost for GDM Alignment blogpostWork done by the GDM Amplified Oversight team (we're hiring).TL;DR: When you RL against an LLM judge, the judge gets hacked i.e. fooled into incorrectly giving… Save Read
Zac Boring 2 months ago Research GxP-Agent: Process-DAG Topology for Reliable Clinical Trial Programming with LLM Agents via ArXiv cs.AI [4] — Clinical trial programming -- transforming study protocols into analysis-ready datasets under CDISC standards -- is a bottleneck in regulatory submissions, yet LLM-based code generation fails catastrophically on this task: across 11 single-shot attempts… Save Read
Zac Boring 2 months ago Analysis Essential Anthropic Risk Report: August 2026 via Substack Zvi [999] — I am grateful that Anthropic is producing periodic Risk Reports. Save Read