Evidence about risk should be transparent
Key takeaway
All views are my own and do not represent my employer.In the wake of the recent wave of misalignment incidents, both OpenAI and Anthropic have reported slowing down RL training to improve safety.
Why it's on PDOOM
PDOOM selected this story as relevant to risk analysis.
From LessWrong AI
All views are my own and do not represent my employer.In the wake of the recent wave of misalignment incidents, both OpenAI and Anthropic have reported slowing down RL training to improve safety. These incidents, combined with an apparent acceleration in the already-blistering pace of AI progress,[1] have led a number of researchers and leaders in the industry to believe that the risk that humanity loses control of AI is now urgent enough to warrant slowing down the pace of AI development soon.T
By Ajeya Cotra