Skip to main content

Table of Contents | Search Technical Documentation | References

NAEP Analysis and Scaling → Initial Activities → Constructed-Response Interrater Reliability → Score Range and Percentage of Exact Agreement for the Constructed-Response Items from Previous Year 2017, Rescored in 2019, Grade 8 Mathematics Combined National and State Assessment, by Block and Item: 2019

​​NAEP Technical DocumentationScore Range and Percentage of Exact Agreement for the Constructed-Response Items from Previous Year 2017, Rescored in 2019, Grade 8 Mathematics Combined National and State Assessment, by Block and Item: 2019

Score range and percentage of exact agreement for the constructed-response items from previous year 2017, rescored in 2019, grade 8 mathematics combined national and state assessment, by block and item: 2019
Block Item Score range Sample size Percentage of exact agreement
Special codes assigned to student responses including omitted, off-task, and illegible were included in the calculation of the percentage of exact agreement measure.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2019 Mathematics Assessment.
M1 M252001 2 1,600 99
M1 M381603 2 1,600 97
M1 M381604 2 1,600 97
M1 M381605 2 1,600 98
M1 M381901 2 1,600 100
M2 M379901 3 1,600 99
M2 M382902 3 1,600 98
M2 M384001 2 1,600 99
M2 M384002 2 1,600 100
M2 M384003 2 1,600 100
M2 M386102 3 1,600 88
M3 M250301 2 1,600 100
M3 M251401 2 1,600 100
M4 M222301 3 1,600 98
M4 M232101 2 1,900 99
M4 M351901 2 1,600 99
M4 M351902 2 1,600 99
M4 M352301 3 1,600 98
M5 M223101 3 1,600 99
M5 M223301 3 1,600 89
M5 M223801 3 1,900 99
M6 M104901 3 1,600 98
M6 M163105 3 1,600 99
M6 M167901 3 1,600 92
M6 M233601 3 1,600 98
M7 M221701 2 1,900 99
M7 M231501 2 1,600 97
M7 M234001 2 1,600 100
M8 M386701 2 1,600 99
M8 M387303 2 1,600 98
M8 M387304 2 1,600 100
M8 M387305 2 1,600 99
M8 M388201 3 1,900 99
M8 M388300 3 1,600 99
M9 M253301 3 1,600 99
M10 M234702 3 1,600 99
M10 M235501 2 2,000 99
M10 M237901 3 1,600 99
M10 M239001 3 1,600 99
M11 M247801 2 1,600 100
M11 M250201 2 1,600 100
M11 M251701 2 1,800 100
M12 M248501 2 1,600 100
M12 M384402 3 1,600 100
M14 M251201 2 1,600 99
M14 M252201 2 1,600 100
​

Score range, Cohen's Kappa, and intraclass correlation for the constructed-response items from previous year 2017, rescored in 2019, grade 8 mathematics combined national and state assessment, by block and item: 2019
BlockItemScore rangeSample sizeCohen's KappaIntraclass correlation
Not applicable. The intraclass correlation is not reported for dichotomously scored items.
The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including omitted, off-task, and illegible were not included in the calculation of Cohen's Kappa or intraclass correlation.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2019 Mathematics Assessment.
M1M25200121,600.98
M1M38160321,500.95
M1M38160421,500.93
M1M38160521,300.90
M1M38190121,6001.00
M2M37990131,400.99.99
M2M38290231,500.98.99
M2M38400121,600.99
M2M38400221,500.99
M2M38400321,5001.00
M2M38610231,600.72.83
M3M25030121,6001.00
M3M25140121,6001.00
M4M22230131,500.99.99
M4M23210121,8001.00
M4M35190121,600.99
M4M35190221,500.99
M4M35230131,600.98.99
M5M22310131,600.98.99
M5M22330131,500.79.83
M5M22380131,700.991.00
M6M10490131,600.96.98
M6M16310531,600.991.00
M6M16790131,600.77.85
M6M23360131,500.98.99
M7M22170121,900.99
M7M23150121,500.99
M7M23400121,600.98
M8M38670121,500.99
M8M38730321,500.95
M8M38730421,4001.00
M8M38730521,300.97
M8M38820131,800.98.99
M8M38830031,600.98.98
M9M25330131,600.99.99
M10M23470231,600.99.99
M10M23550121,900.99
M10M23790131,600.99.99
M10M23900131,600.99.99
M11M24780121,6001.00
M11M25020121,600.99
M11M25170121,8001.00
M12M24850121,600.99
M12M38440231,600.99.99
M14M25120121,600.99
M14M25220121,600.99
​

Last updated 05 October 2023 (SK)