|Block||Item||Range of response codes||Sample size||Percent exact agreement||Cohen's Kappa1||Intraclass correlation2|
|† Not applicable. The intraclass correlation is not reported for dichotomously scored items; Cohen's Kappa is not reported for polytomously scored items.
1 Cohen’s Kappa is a measure of reliability that is appropriate for items that are dichotomously scored.
2 The intraclass correlation coefficient is most appropriate for items with more than two categories.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2001 Geography Assessment.