Table of Contents | Search Technical Documentation | References
| Block | Item | Score range | Sample size | Percentage of exact agreement |
|---|---|---|---|---|
| R1 | R059604 | 1-2 | 1,900 | 91 |
| R059605 | 1-3 | 1,700 | 76 | |
| R059606 | 1-3 | 1,900 | 85 | |
| R059607 | 1-3 | 1,600 | 89 | |
| R059610 | 1-4 | 1,600 | 82 | |
| R2 | R069801 | 1-3 | 1,600 | 93 |
| R069804 | 1-3 | 1,900 | 82 | |
| R069806 | 1-4 | 1,600 | 72 | |
| R069810 | 1-3 | 1,600 | 82 | |
| R3 | R060103 | 1-2 | 1,700 | 84 |
| R060105 | 1-2 | 1,900 | 92 | |
| R060108 | 1-4 | 1,600 | 68 | |
| R6 | R058602 | 1-3 | 1,900 | 82 |
| R058606 | 1-3 | 1,900 | 88 | |
| R058608 | 1-4 | 1,600 | 76 | |
| R7 | R058805 | 1-3 | 1,600 | 85 |
| R058807 | 1-4 | 1,600 | 78 | |
| R058810 | 1-3 | 1,600 | 79 | |
| R9 | R060503 | 1-3 | 1,600 | 92 |
| R060505 | 1-4 | 1,600 | 78 | |
| R060507 | 1-3 | 1,600 | 73 | |
| R060508 | 1-3 | 1,600 | 78 | |
| R060509 | 1-3 | 1,900 | 83 | |
| R10 | R060603 | 1-3 | 1,900 | 81 |
| R060605 | 1-3 | 1,600 | 86 | |
| R060606 | 1-4 | 1,600 | 77 | |
| R060607 | 1-3 | 1,900 | 79 | |
| R060608 | 1-3 | 1,600 | 85 | |
| R11 | R069603 | 1-3 | 1,600 | 92 |
| R069606 | 1-3 | 1,600 | 82 | |
| R069607 | 1-4 | 1,600 | 77 | |
| R069609 | 1-3 | 1,900 | 83 | |
| R12 | R061003 | 1-3 | 1,700 | 85 |
| R061004 | 1-2 | 1,900 | 95 | |
| R061006 | 1-2 | 1,600 | 92 | |
| R061007 | 1-4 | 1,600 | 70 | |
| R061010 | 1-3 | 1,600 | 78 | |
| R13 | R069705 | 1-2 | 1,900 | 92 |
| R069706 | 1-3 | 1,600 | 87 | |
| R069707 | 1-4 | 1,600 | 79 | |
| R069708 | 1-3 | 1,600 | 72 | |
| NOTE: Special codes assigned to student responses including blank,
off-task, and not-scorable were included in the calculation of the
percentage of exact agreement measure. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2015 Reading Assessment. | ||||
| Block | Item | Score range | Sample size | Cohen’s Kappa | Intraclass correlation |
|---|---|---|---|---|---|
| R1 | R059604 | 1-2 | 1,700 | .66 | † |
| R059605 | 1-3 | 1,500 | .57 | .72 | |
| R059606 | 1-3 | 1,700 | .72 | .83 | |
| R059607 | 1-3 | 1,400 | .80 | .89 | |
| R059610 | 1-4 | 1,400 | .73 | .88 | |
| R2 | R069801 | 1-3 | 1,400 | .85 | .87 |
| R069804 | 1-3 | 1,700 | .68 | .79 | |
| R069806 | 1-4 | 1,400 | .54 | .74 | |
| R069810 | 1-3 | 1,400 | .70 | .81 | |
| R3 | R060103 | 1-2 | 1,500 | .62 | † |
| R060105 | 1-2 | 1,700 | .82 | † | |
| R060108 | 1-4 | 1,400 | .52 | .72 | |
| R6 | R058602 | 1-3 | 1,700 | .69 | .76 |
| R058606 | 1-3 | 1,700 | .80 | .82 | |
| R058608 | 1-4 | 1,400 | .63 | .83 | |
| R7 | R058805 | 1-3 | 1,400 | .72 | .79 |
| R058807 | 1-4 | 1,400 | .64 | .84 | |
| R058810 | 1-3 | 1,500 | .61 | .70 | |
| R9 | R060503 | 1-3 | 1,500 | .88 | .92 |
| R060505 | 1-4 | 1,400 | .68 | .86 | |
| R060507 | 1-3 | 1,400 | .47 | .54 | |
| R060508 | 1-3 | 1,500 | .58 | .67 | |
| R060509 | 1-3 | 1,700 | .70 | .79 | |
| R10 | R060603 | 1-3 | 1,700 | .68 | .80 |
| R060605 | 1-3 | 1,400 | .72 | .77 | |
| R060606 | 1-4 | 1,400 | .58 | .76 | |
| R060607 | 1-3 | 1,700 | .51 | .59 | |
| R060608 | 1-3 | 1,400 | .76 | .83 | |
| R11 | R069603 | 1-3 | 1,400 | .86 | .92 |
| R069606 | 1-3 | 1,400 | .60 | .67 | |
| R069607 | 1-4 | 1,400 | .64 | .82 | |
| R069609 | 1-3 | 1,700 | .73 | .84 | |
| R12 | R061003 | 1-3 | 1,500 | .74 | .84 |
| R061004 | 1-2 | 1,700 | .78 | † | |
| R061006 | 1-2 | 1,400 | .82 | † | |
| R061007 | 1-4 | 1,400 | .51 | .70 | |
| R061010 | 1-3 | 1,400 | .59 | .70 | |
| R13 | R069705 | 1-2 | 1,700 | .78 | † |
| R069706 | 1-3 | 1,400 | .75 | .83 | |
| R069707 | 1-4 | 1,500 | .64 | .84 | |
| R069708 | 1-3 | 1,400 | .52 | .67 | |
|
† Not applicable. The intraclass correlation is not reported for dichotomously scored items. NOTE: The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including blank, off-task, and not-scorable were not included in the calculation of Cohen's Kappa or intraclass correlation. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2015 Reading Assessment. | |||||