Which forms of reliability provide evidence of scoring consistency among raters?

• A. Inter-rater reliability.
• B. Test-retest reliability.
• C. Parallel-forms reliability.
• D. Internal-consistency reliability.

Answer: (A)

Scoring consistency among raters is about how similarly different people apply the same scoring criteria to the same responses. This is what inter-rater reliability captures. When multiple raters evaluate the same performance or item, high inter-rater reliability means their scores align closely, indicating the scoring process is reliable regardless of who applies it. In practice, you’d quantify this with statistics like Cohen’s kappa for categorical judgments or intraclass correlation for numerical scores.

Other forms of reliability address different ideas. Test-retest reliability looks at stability of scores over time, not agreement between raters. Parallel-forms reliability checks consistency between different versions of a test. Internal-consistency reliability assesses how well the items on a single test hang together to measure the same construct, focusing on item coherence rather than who scores them.