kaal:claim:7456999-011

The cohort does not show that the highest-record selector beats shipping an artifact that passes the visible checks because the measured margin is 0.037 and its interval contains zero.

Source quote, verbatim
The highest-record selector has not been shown to beat the alternative a competent engineer would actually deploy, which is to ship whatever satisfies the checks already in hand. The point estimate favors the record by 0.0374 across twenty-two specifications, with a ninety-five percent interval of [-0.102, +0.176], winning nine, losing seven and tying six. The interval contains zero and one specification is worth 0.045.
From

Wulf A. Kaal, Reinforcement Learning from Reputation Feedback (2026), V.A.4 What the cohort does not show, stated at the same volume, p. 22
https://ssrn.com/abstract=7456999 · source PDF

Cite as

Wulf A. Kaal, Reinforcement Learning from Reputation Feedback (2026). SSRN: https://ssrn.com/abstract=7456999

Holds when
Classification

failuresupport: evidencedempirical-evidenceresearch-methodsai-and-agents

Verify

The quote above is an exact passage from the source PDF, whose sha256 is 01016fbbcc25cad205cebd59ea686d8dfee8ae9b632095d86ba6c9a900456a4b.
Verify the binding yourself: curl -s https://wulfkaal.github.io/claims/7456999-011.md | sha256sum