kaal:claim:7456999-061
The record's measured advantage over passing visible checks changes sign under an arbitrary file-order tie-break, so the quantity is not resolved at this sample size.
Source quote, verbatim
That comparison is also unstable in a way the interval already implies. Selecting the first satisfying artifact in file order, an arbitrary choice, reverses the sign and the record loses by 0.0511. Averaging over which satisfying artifact is chosen, which is the honest treatment because file order carries no meaning, the record wins by 0.0374. A quantity that changes sign under a tie-break has not been measured at this sample size.
From
Cite as
Holds when
Classification
failuresupport: evidencedempirical-evidenceresearch-methodsai-and-agents
Verify