A fitted reputation reward model can learn style correlations absent from an externally checked outcome, and no such reward model is trained or tested in the paper.
Source quote, verbatim
A fitted model can learn style correlations absent from . No RRM is trained or tested in this paper, so resistance to reward hacking is not claimed.
The quote above is an exact passage from the source PDF, whose sha256 is 01016fbbcc25cad205cebd59ea686d8dfee8ae9b632095d86ba6c9a900456a4b. Verify the binding yourself: curl -s https://wulfkaal.github.io/claims/7456999-068.md | sha256sum