Minimum required pacing: finish aligning it before you train the next one
Key takeaway
Let's say we coordinate to pace the frontier, but we don't coordinate on an outright pause.
Why it's on PDOOM
PDOOM selected this story for its alignment & control signals: Alignment, Capabilities.
AlignmentCapabilitiesFrom Alignment Forum
Let's say we coordinate to pace the frontier, but we don't coordinate on an outright pause. What should the standard of pacing be?My proposal for a minimum requirement: a lab cannot train the next generation of models (in terms of capabilities) until they have adequately[1] resolved all significant alignment issues in the present generation of models.You don't launch a jet that goes at Mach 3 before you've figured out why your Mach 2 jet keeps crashing[2]. With any other kind of dangerous techno
By orthonormal