PSA: Almost nobody is working on alignment
People often assume that a large fraction of the AI safety community works on alignment. As far as we're aware, this is not true. Most people are not working on making sure superintelligent AIs are aligned with human values or follow human instructions.Currently, the people who we know of that work on alignment are roughly:The Alignment Research Center who work on a research bet by Paul ChristianoProbably Sequent who just got announced yesterdayParts of GDM (agent foundations work, some debate w
By Chi Nguyen