Skip to main content

Table of Contents | Search Technical Documentation | References

NAEP Analysis and Scaling → Initial Activities → Constructed-Response Interrater Reliability → Score Range and Percentage of Exact Agreement for the Constructed-Response Items from Previous Year 2017, Rescored in 2019, Grade 4 Reading Combined National and State Assessment, by Block and Item: 2019

​​NAEP Technical DocumentationScore Range and Percentage of Exact Agreement for the Constructed-Response Items from Previous Year 2017, Rescored in 2019, Grade 4 Reading Combined National and State Assessment, by Block and Item: 2019

Score range and percentage of exact agreement for the constructed-response items from previous year 2017, rescored in 2019, grade 4 reading combined national and state assessment, by block and item: 2019
Block Item Score range Sample size Percentage of exact agreement
Special codes assigned to student responses including omitted, off-task, and illegible were included in the calculation of the percentage of exact agreement measure.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2019 Reading Assessment.
R1 R068904 2 1,800 92
R1 R068907 4 1,600 79
R1 R068910 3 1,600 73
R2 R057806 4 1,600 81
R2 R057807 2 1,600 94
R2 R057809 3 1,600 85
R3 R079306 3 1,400 78
R3 R079307 4 1,600 73
R3 R079309 3 1,600 78
R4 R070204 3 1,600 82
R4 R070206 4 1,600 84
R4 R070210 3 1,600 80
R6 R058602 3 1,600 74
R6 R058606 3 1,600 90
R6 R058608 4 1,400 75
R7 R058805 3 1,000 84
R7 R058807 4 1,600 71
R7 R058810 3 1,600 77
R8 R079703 3 1,600 86
R8 R079706 3 1,600 92
R8 R079707 4 1,400 86
R8 R079709 3 1,400 83
R9 R088302 3 1,600 74
R9 R088308 2 1,600 91
R9 R088309 4 1,400 80
R9 R088310 3 1,600 76
​

Score range, Cohen's Kappa, and intraclass correlation for the constructed-response items from previous year 2017, rescored in 2019, grade 4 reading combined national and state assessment, by block and item: 2019
BlockItemScore rangeSample sizeCohen's KappaIntraclass correlation
Not applicable. The intraclass correlation is not reported for dichotomously scored items.
The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including omitted, off-task, and illegible were not included in the calculation of Cohen's Kappa or intraclass correlation.
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2019 Reading Assessment.
R1R06890421,700.87
R1R06890741,400.68.83
R1R06891031,500.66.77
R2R05780641,400.71.84
R2R05780721,500.87
R2R05780931,400.74.79
R3R07930631,300.71.82
R3R07930741,500.69.79
R3R07930931,400.70.81
R4R07020431,400.75.83
R4R07020641,400.76.90
R4R07021031,400.68.82
R6R05860231,400.62.74
R6R05860631,400.82.85
R6R05860841,300.67.85
R7R0588053900.72.81
R7R05880741,500.64.83
R7R05881031,500.61.72
R8R07970331,500.78.84
R8R07970631,500.89.95
R8R07970741,300.88.95
R8R07970931,200.70.80
R9R08830231,500.66.74
R9R08830821,400.85
R9R08830941,300.70.85
R9R08831031,500.59.67
​

Last updated 05 October 2023 (SK)