Alignment & Succession: The Two Bars of Alignment
Key takeaway
(Originally published on No Set Gauge June 24th 2026.)Rembrandt, Saul and DavidWhen people talk about AI being “aligned”, I think there’s a lot of conflation between two different bars of success:The AI does what you say and does not go rogue.
Why it's on PDOOM
PDOOM selected this story for its alignment & control signals: Alignment, Corrigibility.
AlignmentCorrigibilityFrom LessWrong AI
(Originally published on No Set Gauge June 24th 2026.)Rembrandt, Saul and DavidWhen people talk about AI being “aligned”, I think there’s a lot of conflation between two different bars of success:The AI does what you say and does not go rogue. If you ask it to do a machine learning experiment for you, it actually does that instead of scheming against you and escaping onto the internet. If you say “stop”, it stops. (Some AI properties considered important for achieving this bar are corrigibility,
By L Rudolf L