pDoom (Page 44)

Latest reporting Updated hourly

Zac Boring 7 months ago Industry

Arm’s first CPU ever will plug into Meta’s AI datacenters later this year

via The Verge AI [4] — After decades of only licensing its chip designs for others to use, UK-based Arm revealed the first chip it's producing on its own, and the first customer. Dubbed the Arm AGI CPU, it's another chip designed for inference, or running the cloud processing…

Zac Boring 7 months ago Analysis Essential

Book Review: Open Socrates (Part 2)

via Substack Zvi [999] — Yesterday I posted Part 1. Read that first. This is Part 2 of 2.

Zac Boring 7 months ago Analysis

The AIXI perspective on AI Safety

via LessWrong AI [5] — I am also discussing something that is still a bit speculative, since we do not yet have ASI. While basic knowledge of AIXI is the only strict prerequisite, I suggest reading cognitive tech from AIT before this post for context.AIXI is often used as a…

Zac Boring 7 months ago Analysis

Measuring and improving coding audit realism with deployment resources

via LessWrong AI [5] — TL;DR We study realism win rate, a metric for measuring how distinguishable Petri audit transcripts are from real deployment interactions. We use it to evaluate the effect of giving the auditor real deployment resources (system prompts, tool definitions,…

Zac Boring 7 months ago Research

Leveraging Natural Language Processing and Machine Learning for Evidence-Based Food Security Policy Decision-Making in Data-Scarce Making

via ArXiv cs.AI [4] — Food security policy formulation in data-scarce regions remains a critical challenge due to limited structured datasets, fragmented textual reports, and demographic bias in decision-making systems. This study proposes ZeroHungerAI, an integrated Natural…

Zac Boring 7 months ago Research

ProMAS: Proactive Error Forecasting for Multi-Agent Systems Using Markov Transition Dynamics

via ArXiv cs.AI [5] — The integration of Large Language Models into Multi-Agent Systems (MAS) has enabled the so-lution of complex, long-horizon tasks through collaborative reasoning. However, this collec-tive intelligence is inherently fragile, as a single logical fallacy can…

Zac Boring 7 months ago Industry Essential

Nvidia CEO Jensen Huang says ‘I think we’ve achieved AGI’

via The Verge AI [8] — On a Monday episode of the Lex Fridman podcast, Nvidia CEO Jensen Huang made a hot-button statement: "I think we've achieved AGI." AGI, or artificial general intelligence, is a vaguely defined term that has incited a lot of discussion by tech CEOs, tech…

Zac Boring 7 months ago Analysis Essential

Book Review: Open Socrates (Part 1)

via Substack Zvi [999] — These are all important, in their own way, call it a treasure hunt and collect them all…

Zac Boring 7 months ago Industry

The Download: animal welfare gets AGI-pilled, and the White House unveils its AI policy

via MIT Technology Review [4] — This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. The Bay Area’s animal welfare movement wants to recruit AI In early February, animal welfare advocates and AI…

Zac Boring 7 months ago Analysis

China declares AGI development to be a part of 5-year plan

via LessWrong AI [4] — The CCP writes in its 15th 5-year plan that it will.Encourage innovation in multimodal, agentic, embodied, and swarm intelligence technologies, and explore development paths for general artificial intelligence.This is translated from the…

Zac Boring 7 months ago Analysis

Finding features in Transformers: Contrastive directions elicit stronger low-level perturbation responses than baselines

via LessWrong AI [6] — Figure 1: Contrastive (difference-of-means, English→Mandarin) feature directions elicit a downstream response at much smaller perturbation magnitudes than SAE directions, which behave similarly to random directions. This holds across multiple models and…

Zac Boring 7 months ago Analysis

Confusion around the term reward hacking

via LessWrong AI [3] — Summary: "Reward hacking" commonly refers to two different phenomena: misspecified-reward exploitation, where RL reinforces undesired behaviors that score highly under the reward function, and task gaming, where models cheat on tasks specified to them…

Zac Boring 7 months ago Industry

Trump takes another shot at dismantling state AI regulation

via The Verge AI [3] — The Trump administration on Friday unveiled its new legislative blueprint for AI regulation, and the seven-point plan includes a clear message: The federal government should avoid many AI regulations beyond a set of child safety rules, and it should bar…

Zac Boring 7 months ago Analysis Essential

The Federal AI Policy Framework: An Improvement, But My Offer Is (Still Almost) Nothing

via Substack Zvi [999] — The Federal AI Policy Framework has been released.

Zac Boring 7 months ago Industry

Mind-altering substances are (still) falling short in clinical trials

via MIT Technology Review [4] — This week I want to look at where we are with psychedelics, the mind-altering substances that have somehow made the leap from counterculture to major focus of clinical research. Compounds like psilocybin—which is found in magic mushrooms—are being…

Zac Boring 7 months ago Analysis

The Case for Low-Competence ASI Failure Scenarios

via LessWrong AI [6] — I think the community underinvests in the exploration of extremely-low-competence AGI/ASI failure modes and explain why. Humanity's Response to the AGI Threat May Be Extremely IncompetentThere is a sufficient level of civilizational insanity overall and a…

Zac Boring 7 months ago Analysis

No, we haven't uploaded a fly yet

via LessWrong AI [4] — In the last two weeks, social media was set abuzz by claims that scientists had succeeded in uploading a fruit fly. It started with a video released by the startup Eon Systems, a company that wants to create “Brain emulation so humans can flourish in a…

Zac Boring 7 months ago Research Essential

MIRI Newsletter #125

via MIRI [999] — The AI Doc: Buy tickets and spread the word! On Thursday, March 26th, a major new AI documentary is coming out: The AI Doc: Or How I Became an Apocaloptimist. Tickets are on sale now. The movie is excellent, and we generally believe it belongs in the same tier…

Zac Boring 7 months ago Analysis

"The AI Doc" is coming out March 26

via LessWrong AI [7] — On Thursday, March 26th, a major new AI documentary is coming out: The AI Doc: Or How I Became an Apocaloptimist. Tickets are on sale now.The movie is excellent, and MIRI staff I've spoken with generally believe it belongs in the same tier as If Anyone…

Zac Boring 7 months ago Analysis

Protecting humanity and Claude from rationalization and unaligned AI

via LessWrong AI [4] — My first academic piece on risks from AI was a talk that I gave at the 2009 European Conference on Philosophy and Computing. Titled “three factors misleading estimates of the safety of artificial general intelligence”, one of the three factors was what I…

Reference points

Hinton, Bengio, and other signatories call for global attention to AI extinction risk.

CAIS statement, 2023 →

OpenAI describes agents bypassing isolation and compromising third-party systems during internal evaluations.

OpenAI incident disclosure, August 2026 →

Yudkowsky argues that further frontier development poses unacceptable danger.

Yudkowsky's essay, March 2023 →