kaal:claim:7314479-024
Evaluation must derive from observed results under stated conditions, be specific to context, and be costly to manipulate, which excludes self-declared capability, averaged scores across incommensurable tasks, and most engagement metrics.
Source quote, verbatim
Evaluation must derive from observed results under stated conditions, must be specific to context, and must be costly to manipulate. Each clause excludes a common practice. Observed results excludes self-declared capability. Stated conditions excludes aggregate scores that average across incommensurable tasks. Costly to manipulate excludes any signal a participant can generate at will, which in practice excludes most engagement metrics.
From
Cite as
Holds when
Classification
normativesupport: arguedreputationresearch-methodsrisk-and-incentives
Verify
Positions extending this scholarly claim