Null Controls Are Necessary but Not Sufficient: Evaluating Acceptance Guards for Scientific Discovery and Interpretability
Key takeaway
Automated discovery systems propose scientific explanations and test which to accept.
Why it's on PDOOM
PDOOM selected this story for its alignment & control signals: Interpretability.
InterpretabilityFrom ArXiv cs.AI
Automated discovery systems propose scientific explanations and test which to accept. Does passing a test establish the intended claim? We develop four executable operations for changing physical descriptions: identifying redundancies (L1), coarse-graining dynamics (L2), transferring structure (L3), and inferring missing quantities from conservation imbalances (L4). We evaluate these operations and three interpretability settings through null accep
By Tianyu Wu (Project Aether)