Conformance as a Distribution: Delegation Contracts, Error Budgets, and the Allocation of Evaluation Authority in Use-Based AI Regulation
Key takeaway
Use-based AI regulation assigns obligations by deployment risk but lacks an evidentiary object to carry them.
Why it's on PDOOM
PDOOM selected this story for its governance & policy signals: Regulation, Benchmark.
RegulationBenchmarkFrom ArXiv cs.AI
Use-based AI regulation assigns obligations by deployment risk but lacks an evidentiary object to carry them. A benchmark score is a property of a model; conformance of a deployment is a failure rate under a declared distribution of contexts, bounded by a scope and subject to expiry. We take the delegation contract of earlier work (frozen configuration, scoped claim, executable revision rule) and study it under strategic play between a deployer, an
By John deVadoss