kaal:claim:7456999-062
The sweep's 67.7 percent annotator baseline is a simulated output rather than a published agreement rate or a measurement of human annotators.
Source quote, verbatim
In the sweep, the modeled RLHF baseline settles at 67.7% accuracy and RLRF exceeds 0.97, both under parameters the sweep sets. Neither figure is a published agreement rate, and Part V.B.1 explains why calling 67.7 the Ouyang-Coste bound conflates an output of the model with an input to it.
From
Cite as
Holds when
Classification
failuresupport: assertedresearch-methodsempirical-evidenceai-and-agents
Verify