No Strong Orthogonality From Selection Pressure
A postratfic version of this essay, together with the acknowledgements for both, is available on SubstackEdit: if no one thinks an agent can become superintelligent and contest the lightcone while maintaining arbitrarily stupid goals, thats great! I’m only interested in refuting the version that would allow for a superintelligence AND a total absence of value.See here for an analysis of earlier instances of the present motte and bailey.TL;DRIf everything goes according to plan, by the end of thi
By lumpenspace