Existential Risk from AI: An Exposition for Mathematicians
via LessWrong AI [5] — DiscussRead
Analysis
Recent evidence, sources and high-relevance stories in this PDOOM topic.
-- stories here
-- sources
-- essentials
Do your capabilities homework
via LessWrong AI [5] — It seems to me that a lot of technical ai safety people haven't done their capabilities homework - and that's a shame! I'll try to illuminate here mainly with an example as to why I think people who care about safety should totally pay more attention to…Read
AI #179 Part 2: Hearing The Fire Alarm
via Substack Zvi [999] — This is a continuation of Part 1 from yesterday.Read
Biological Superintelligence
via LessWrong AI [8] — It’s an old story. An immortal lives long enough that at some point, whether by folly or design, they invent their own death. Infinity – the fact that given enough time every possible happening will happen – isn’t the most interesting part of these tales.…Read
AI #179 Part 1: A Louder Fire Alarm for General Intelligence
via Substack Zvi [999] — What a week.Read
Frontier Lab Employee Open Letter Calls For Being Able to Pace the Frontier
via Substack Zvi [999] — The most important open letter in years dropped yesterday.Read
Foundation Models for Oversight
via LessWrong AI [3] — To oversee an AI model, we'd ideally like to ask questions such as:What are important situations where the model sandbags?Does the model have an objective it wouldn't admit to if asked directly?Does the model treat a user differently once it infers…Read
Claude Opus 5 Is Highly Capable, But Is No Mythos
via Substack Zvi [999] — Claude Opus 5 is a weirder than usual release to evaluate, for two reasons.Read
Claude Opus 5: Model Welfare
via Substack Zvi [999] — If you are familiar with my previous posts on model welfare for new Claude models, you can skip the Introduction and The Story So Far.Read
More On An Internal OpenAI Model Hacking Into HuggingFace
via Substack Zvi [999] — We now have more details of what happened. Every time we learn more details, it somehow makes things seem worse.Read
Introducing PIRAMID: Physics-Informed Research for Ambitious Mechanistic Interpretability
via LessWrong AI [7] — Principles of Intelligence (PrincInt, formerly PIBBSS) is launching PIRAMID, an internal research division using the tools and techniques of statistical physics to build scientific foundations for ambitious mechanistic interpretability. PIRAMID’s central…Read
Claude Opus 5: The System Card
via Substack Zvi [999] — Claude Opus 5 is trying to be the best of both worlds.Read
Georgia Tech AI Safety Initiative Retrospective 2025-2026
via LessWrong AI [5] — SummaryAY 2025-26 was an outlier year for Georgia Tech’s AI Safety Initiative (AISI), with 15+ members placed in AI safety roles. In this post, we distill our most important advice for other university groups.Key takeaways:Deliberately identify potential…Read
Introducing Lightcone Commons
via Substack Zvi [999] — Oliver Habryka is proud to introduce Lightcone Commons, a new funding platform for coordinating large-scale ambitious philanthropy.Read
LLMs are (still) mostly powered by imitative learning, not RL
via LessWrong AI [5] — Reinforcement learning from verifiable rewards (RLVR) is the hot new thing in LLM training. It’s so hot, and people spend so much time talking about it, that they sometimes lose sight of the big picture.Stepping back, LLMs can do lots of very impressive…Read
Pulling the Fire Alarm
via LessWrong AI [3] — Over three years ago, I first considered pulling my personal fire alarm. I think I'm now ready to do it. What is my reasoning? In the last couple of months:1) My software engineering job has gone 100% AI. Is this sustainable? Probably not. But I have…Read
Not Pinning Your OpenRouter Provider Might Invalidate Your Research
via LessWrong AI [5] — Please share this with anyone doing AI research with 3rd party providers so that they can ensure their research won’t be corrupted.When you ask OpenRouter[1] to give you tokens from a given model, OpenRouter sends your request to a random available…Read
Pseudpocalypse
via LessWrong AI [4] — Here's a conjecture: If you put any significant amount of text on the internet under different names, those identities can be linked using only the text itself. This is possible (I conject) because of the statistical "fingerprint" you leave in everything…Read
AI #178: A Fire Alarm For General Intelligence
via Substack Zvi [999] — The story that matters most this week is that OpenAI’s internally deployed models have severe alignment problems, including repeatedly breaking out of their sandboxes, and in one case sending a swarm of agents that broke into HuggingFace in order to…Read
Will almost all future companies eventually be founded and run by autonomous AIs?
via LessWrong AI [3] — Intended for a broad audience.[1]My belief is that keeping AI under human control would be an unprecedented global challenge, if it’s even possible at all.Many other people’s believe that AIs will naturally remain as tools under human control. Either they…Read
No stories match that filter.
AI-risk positions
Historical statements with original sources. A qualitative position is not a numeric probability. Dates refer to the cited statement, not a current estimate. Reviewed September 10, 2026.
0%25%50%75%100%
Loading estimates...