Skip to main content

Table of Contents | Search Technical Documentation | References

NAEP Analysis and Scaling → Initial Activities → Constructed-Response Interrater Reliability → Score Range and Percentage of Exact Agreement for the Constructed-Response Items Used in Scaling, Age 9 Mathematics Long-Term Trend National Assessment, by Block and Item: 2020

​​​​NAEP Technical DocumentationScore Range and Percentage of Exact Agreement for the Constructed-Response Items Used in Scaling, Age 9 Mathematics Long-Term Trend National Assessment, by Block and Item: 2020

Score range and percentage of exact agreement for the constructed-response items used in scaling, age 9 mathematics long-term trend national assessment, by block and item: 2020
Block Item Score range Sample size Percentage of exact agreement
Special codes assigned to student responses including omitted, off-task, and illegible were included in the calculation of the percentage of exact agreement measure.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2020 Mathematics Long-Term Trend Assessment.
M1 N329101 2 1,000 100
M1 N329201 2 1,000 100
M1 N329501 2 1,000 100
M1 N331501 2 1,000 100
M1 N331601 2 1,000 100
M1 N331701 2 1,000 100
M1 N331901 2 1,000 100
M1 N332101 2 1,000 100
M2 N294201 2 1,100 100
M2 N294301 2 1,100 99
M2 N295301 2 1,100 100
M2 N295401 2 1,100 100
M2 N295701 2 1,100 99
M3 N322401 2 1,100 99
M3 N323101 2 1,100 100
M3 N323701 2 1,100 100
M3 N323901 2 1,100 99
M3 N324001 2 1,100 98
M4 N312901 2 1,100 98
M4 N313001 2 1,100 99
M4 N313101 2 1,100 100
M4 N313102 2 1,100 99
M4 N313103 2 1,100 99
M4 N313701 2 1,100 100
M4 N313702 2 1,100 99
M4 N313801 2 1,100 100
M4 N313901 2 1,100 99
M5 N287601 2 1,100 99
M5 N288101 2 1,100 100
M5 N288501 2 1,100 99
M5 N289201 2 1,100 100
M6 N289701 2 1,000 100
M6 N289901 2 1,000 100
M6 N290101 2 1,000 100
M6 N290701 2 1,000 100
M6 N291501 2 1,000 100
​

Score range, Cohen's Kappa, and intraclass correlation for the constructed-response items used in scaling, age 9 mathematics long-term trend national assessment, by block and item: 2020
BlockItemScore rangeSample sizeCohen's KappaIntraclass correlation
Not applicable. The intraclass correlation is not reported for dichotomously scored items.
The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including omitted, off-task, and illegible were not included in the calculation of Cohen's Kappa or intraclass correlation.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2020 Mathematics Long-Term Trend Assessment.
M1N3291012900.99
M1N32920121,000.99
M1N32950121,000.99
M1N33150129001.00
M1N33160129001.00
M1N33170121,0001.00
M1N33190128001.00
M1N3321012700.99
M2N29420121,000.96
M2N29430121,000.98
M2N29530121,0001.00
M2N2954012900.99
M2N2957012800.99
M3N32240121,100.99
M3N32310121,000.99
M3N3237012900.99
M3N3239012900.99
M3N3240012900.99
M4N31290121,100.99
M4N31300121,100.99
M4N31310121,100.99
M4N31310221,1001.00
M4N31310321,100.99
M4N3137012900.99
M4N3137022900.98
M4N3138012900.99
M4N3139012900.99
M5N2876012900.99
M5N28810121,000.99
M5N2885012900.99
M5N2892012900.99
M6N28970121,0001.00
M6N28990121,0001.00
M6N29010121,000.99
M6N29070121,000.99
M6N29150128001.00
​

Last updated 28 March 2024 (SK)