Plan R: AI Safety by ASICs
Key takeaway
Much of the civilization-scale risk we are seeing in AI in 2026 comes from the following combination: we created a single institution (the "Frontier AI Company") that has two properties: A.
Why it's on PDOOM
PDOOM selected this story for its alignment & control signals: Alignment, Capabilities.
AlignmentCapabilitiesFrom LessWrong AI
Much of the civilization-scale risk we are seeing in AI in 2026 comes from the following combination: we created a single institution (the "Frontier AI Company") that has two properties: A. It is set up to create very powerful and/or self-replicating entities that may exceed the capabilities of the entirety of the rest of civilization and come with extraordinary risks B. It gets to own an unbounded financial claim on the resulting surplus All the technical stuff about AI, AI alignment, etc can b
By Roko