Description:
<jats:title>Abstract</jats:title><jats:p>Rater‐mediated assessments are a common methodology for measuring persons, investigating rater behavior, and/or defining latent constructs. The purpose of this article is to provide a pedagogical framework for examining rater variability in the context of rater‐mediated assessments using three distinct models. The first model is the <jats:roman>observation model</jats:roman>, which includes ecological/environmental considerations for the evaluation system. The second model is the <jats:roman>measurement model</jats:roman>, which includes the transformation of observed, rater response data to linear measures using a measurement model with specific requirements of rater‐invariant measurement in order to examine raters’ construct‐relevant variability stemming from the evaluative system. The third model is the <jats:roman>interaction model</jats:roman>, which includes an interaction parameter to allow for the investigation into raters’ systematic, construct‐irrelevant variability stemming from the evaluative system. Implications for measurement outcomes and validity are discussed.</jats:p>