Assessing the impact of safety work needs equilibrium analysis (now more than ever)
Key takeaway
TLDR: This post explains two equilibria which regulate the level of AI safety: The first describes how much resources AI companies are willing to spend on AI safety work due to commercial incentives.
Why it's on PDOOM
PDOOM selected this story for its governance & policy signals: Policy.
PolicyFrom LessWrong AI
TLDR: This post explains two equilibria which regulate the level of AI safety: The first describes how much resources AI companies are willing to spend on AI safety work due to commercial incentives. The second one is about risk awareness and most notably affects government interventions for safety. Doing safety work similar to what AI companies do usually doesn't shift the equilibria much, whereas other work, like more ambitious safety approaches or policy advocacy, do shift them. Both equilibr
By Towards_Keeperhood