kaal:claim:7456999-011
The cohort does not show that the highest-record selector beats shipping an artifact that passes the visible checks because the measured margin is 0.037 and its interval contains zero.
Source quote, verbatim
The highest-record selector has not been shown to beat the alternative a competent engineer would actually deploy, which is to ship whatever satisfies the checks already in hand. The point estimate favors the record by 0.0374 across twenty-two specifications, with a ninety-five percent interval of [-0.102, +0.176], winning nine, losing seven and tying six. The interval contains zero and one specification is worth 0.045.
From
Cite as
Holds when
Classification
failuresupport: evidencedempirical-evidenceresearch-methodsai-and-agents
Verify