Skip to main content

Table of Contents | Search Technical Documentation | References

NAEP Analysis and Scaling → Initial Activities → Constructed-Response Interrater Reliability → Score Range and Percentage of Exact Agreement for the Constructed-Response Items from Previous Year 2022, Rescored in 2024, Grade 4 Mathematics Combined National and State Assessment, by Block and Item: 2024

​​​​​​NAEP Technical DocumentationScore Range and Percentage of Exact Agreement for the Constructed-Response Items from Previous Year 2022, Rescored in 2024, Grade 4 Mathematics Combined National and State Assessment, by Block and Item: 2024​

Score range and percentage of exact agreement for the constructed-response items from previous year 2022, rescored in 2024, grade 4 mathematics combined national and state assessment, by block and item: 2024
Block Item Score range Sample size Percentage of exact agreement
Special codes assigned to student responses including omitted, off-task, and illegible were included in the calculation of the percentage of exact agreement measure.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2024 Mathematics Assessment.
MACC002 MACC02444N01S10 2 1,600 100
MACC002 MACC03694N01S10 3 1,600 99
MACC002 MACC03749N01S10 2 1,600 100
MACC002 MACC03946N01S10 3 1,600 97
MACC004 MACC03421N01S10 3 1,600 98
MACC004 MACC03430N01S10 2 1,600 99
MACC004 MACC03432N01S10 3 1,600 98
MACC005 MACC03707N01S10 2 1,700 99
MACC006 MACC02195N01S10 3 1,700 92
MACC006 MACC02200N01S10 3 1,600 99
MACC006 MACC02207N01S10 3 1,600 88
MACC006 MACC02211N01S10 3 1,600 97
MACC007 MACC01561N01S10 3 1,600 97
MACC007 MACC02311N01S10 2 1,600 96
MACC007 MACC02311N02S10 2 1,600 98
MACC007 MACC02311N03S10 2 1,600 98
MACC007 MACC03394N02S10 3 1,600 98
MACC008 MACC03981N01S10 2 1,600 99
MACC009 MACC03772N01S10 2 1,600 100
MACC009 MACC03788N01S10 3 1,600 97
MACC009 MACC03982N01S10 2 1,600 100
MACC009 MACC03990N01S10 3 1,600 99
MACC009 MACC03999N01S10 2 1,600 98
MACC010 MACC02272N01S10 3 1,600 99
MACC010 MACC02406N01S10 2 1,600 100
MACC010 MACC02408N01S10 2 1,600 99
MACC011 MACC02421N01S10 3 1,600 99
MACC011 MACC03702N01S10 2 1,600 100
MACC011 MACC03702N02S10 2 1,600 100
MACC011 MACC03919N01S10 2 1,600 100
MACC011 MACC04020N01S10 3 1,600 98
MACC012 MACC02450N01S10 3 1,700 95
MACC012 MACC03700N01S10 3 1,600 92
MACC012 MACC03913N01S10 2 1,600 98
MACC012 MACC03923N01S10 2 1,600 100
MACC012 MACC03979N01S10 3 1,600 96
MACC013 MACC02471N01S10 2 1,600 100
MACC013 MACC03933N01S10 2 1,600 100
MACC013 MACC03933N02S10 3 1,600 88
MACC013 MACC03986N01S10 2 1,600 98
MACC013 MACC04012N01S10 2 1,600 100
​

Score range, Cohen's Kappa, and intraclass correlation for the constructed-response items from previous year 2022, rescored in 2024, grade 4 mathematics combined national and state assessment, by block and item: 2024
BlockItemScore rangeSample sizeCohen's KappaIntraclass correlation
Not applicable. The intraclass correlation is not reported for dichotomously scored items.
The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including omitted, off-task, and illegible were not included in the calculation of Cohen's Kappa or intraclass correlation.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2024 Mathematics Assessment.
MACC002MACC02444N01S1021,600.99
MACC002MACC03694N01S1031,600.97.98
MACC002MACC03749N01S1021,6001.00
MACC002MACC03946N01S1031,600.93.97
MACC004MACC03421N01S1031,600.97.98
MACC004MACC03430N01S1021,6001.00
MACC004MACC03432N01S1031,600.97.98
MACC005MACC03707N01S1021,600.99
MACC006MACC02195N01S1031,600.88.95
MACC006MACC02200N01S1031,600.98.99
MACC006MACC02207N01S1031,600.81.86
MACC006MACC02211N01S1031,600.97.98
MACC007MACC01561N01S1031,600.97.99
MACC007MACC02311N01S1021,600.91
MACC007MACC02311N02S1021,500.97
MACC007MACC02311N03S1021,500.97
MACC007MACC03394N02S1031,600.97.99
MACC008MACC03981N01S1021,600.99
MACC009MACC03772N01S1021,600.99
MACC009MACC03788N01S1031,600.93.97
MACC009MACC03982N01S1021,600.99
MACC009MACC03990N01S1031,600.99.99
MACC009MACC03999N01S1021,600.99
MACC010MACC02272N01S1031,600.99.99
MACC010MACC02406N01S1021,600.99
MACC010MACC02408N01S1021,600.99
MACC011MACC02421N01S1031,600.98.99
MACC011MACC03702N01S1021,5001.00
MACC011MACC03702N02S1021,400.99
MACC011MACC03919N01S1021,600.99
MACC011MACC04020N01S1031,600.97.99
MACC012MACC02450N01S1031,600.85.92
MACC012MACC03700N01S1031,600.77.88
MACC012MACC03913N01S1021,500.99
MACC012MACC03923N01S1021,6001.00
MACC012MACC03979N01S1031,600.88.95
MACC013MACC02471N01S1021,6001.00
MACC013MACC03933N01S1021,600.99
MACC013MACC03933N02S1031,500.56.72
MACC013MACC03986N01S1021,500.98
MACC013MACC04012N01S1021,6001.00
​

Last updated 30 June 2026 (SK)