Table of Contents | Search Technical Documentation | References

NAEP Analysis and Scaling → Initial Activities → Constructed-Response Interrater Reliability → Score Range and Percentage of Exact Agreement for the Constructed-Response Items Used in Scaling, Age 13 Reading Long-Term Trend National Assessment, by Block and Item: 2023

​​​​​​NAEP Technical DocumentationScore Range and Percentage of Exact Agreement for the Constructed-Response Items Used in Scaling, Age 13 Reading Long-Term Trend National Assessment, by Block and Item: 2023

Score range and percentage of exact agreement for the constructed-response items used in scaling, age 13 reading long-term trend national assessment, by block and item: 2023
Block Item Score range Sample size Percentage of exact agreement
Special codes assigned to student responses including omitted, off-task, and illegible were included in the calculation of the percentage of exact agreement measure.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2023 Reading Long-Term Trend Assessment.
R1 N021203 5 700 73
R2 N023802 4 700 83
R3 N021803 4 700 85
R4 N022103 4 700 82
R8 N034203 5 700 74
R9 N029002 4 700 80
​

Score range, Cohen's Kappa, and intraclass correlation for the constructed-response items used in scaling, age 13 reading long-term trend national assessment, by block and item: 2023
BlockItemScore rangeSample sizeCohen's KappaIntraclass correlation
The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including omitted, off-task, and illegible were not included in the calculation of Cohen's Kappa or intraclass correlation.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2023 Reading Long-Term Trend Assessment.
R1N0212035700.62.85
R2N0238024700.64.78
R3N0218034700.77.87
R4N0221034700.65.74
R8N0342035700.62.87
R9N0290024700.65.81
​
Last updated 24 July 2024 (SK)