kaal:claim:7456999-008
Among thirty-six repeatedly measured parties, checked-case records predict withheld-case accuracy at a rank correlation of +0.781, and parties failing checked cases passed withheld cases in zero of 168 observations.
Source quote, verbatim
The measured cohort of 564 records, produced by twenty distinct model families against twenty-three speci fications and scored by a deterministic checker on cases withheld from the producing party, establishes that a party’s record where the work is checked predicts its accuracy where it is not, at a rank correlation of +0.781 across thirty-six parties with repeated measurement, and that a party failing the checked cases passes the withheld ones in zero of one hundred and sixty-eight observations.
From
Cite as
Holds when
Classification
empiricalsupport: evidencedempirical-evidencereputationai-and-agents
Verify