Table of Contents | Search Technical Documentation | References
| Block | Item | Range of response codes | Sample size | Percent agreement |
|---|---|---|---|---|
| RA | R059604 | 1-2 | 1,600 | 92 |
| RA | R059605 | 1-3 | 1,600 | 78 |
| RA | R059606 | 1-3 | 1,600 | 83 |
| RA | R059607 | 1-3 | 1,600 | 87 |
| RA | R059610 | 1-4 | 1,600 | 82 |
| RC | R060103 | 1-2 | 1,600 | 85 |
| RC | R060105 | 1-2 | 1,600 | 93 |
| RC | R060108 | 1-4 | 1,600 | 70 |
| RD | R060301 | 1-2 | 1,600 | 91 |
| RD | R060305 | 1-3 | 1,600 | 84 |
| RD | R060306 | 1-4 | 1,600 | 70 |
| RD | R060309 | 1-3 | 1,600 | 79 |
| RE | R058504 | 1-3 | 1,600 | 78 |
| RE | R058508 | 1-4 | 1,600 | 73 |
| RE | R058509 | 1-2 | 1,600 | 91 |
| RF | R058602 | 1-3 | 1,600 | 82 |
| RF | R058606 | 1-3 | 1,700 | 86 |
| RF | R058608 | 1-4 | 1,600 | 76 |
| RG | R058805 | 1-3 | 1,600 | 82 |
| RG | R058807 | 1-4 | 1,600 | 79 |
| RG | R058810 | 1-3 | 1,600 | 82 |
| RH | R059106 | 1-4 | 1,600 | 66 |
| RH | R059108 | 1-3 | 1,600 | 84 |
| RH | R059109 | 1-3 | 1,600 | 76 |
| RH | R059110 | 1-2 | 1,600 | 92 |
| RI | R060503 | 1-3 | 1,600 | 91 |
| RI | R060505 | 1-4 | 1,600 | 77 |
| RI | R060507 | 1-3 | 1,600 | 69 |
| RI | R060508 | 1-3 | 1,600 | 76 |
| RI | R060509 | 1-3 | 1,600 | 83 |
| RJ | R060603 | 1-3 | 1,600 | 80 |
| RJ | R060605 | 1-3 | 1,600 | 87 |
| RJ | R060606 | 1-4 | 1,600 | 76 |
| RJ | R060607 | 1-3 | 1,600 | 81 |
| RJ | R060608 | 1-3 | 1,600 | 89 |
| RL | R061003 | 1-3 | 1,600 | 84 |
| RL | R061004 | 1-2 | 1,600 | 96 |
| RL | R061006 | 1-2 | 1,600 | 91 |
| RL | R061007 | 1-4 | 1,600 | 68 |
| RL | R061010 | 1-3 | 1,600 | 76 |
| NOTE: Special codes assigned to student responses including blank,
off-task, and not-scorable were included in the calculation of the
Percent Exact Agreement measure. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2013 Reading Assessment. | ||||
| Block | Item | Range of response codes | Sample size | Cohen’s Kappa | Intraclass correlation |
|---|---|---|---|---|---|
| R1 | R059604 | 1-2 | 1,500 | .72 | † |
| R1 | R059605 | 1-3 | 1,500 | .59 | .71 |
| R1 | R059606 | 1-3 | 1,400 | .69 | .80 |
| R1 | R059607 | 1-3 | 1,500 | .76 | .87 |
| R1 | R059610 | 1-4 | 1,500 | .72 | .86 |
| R3 | R060103 | 1-2 | 1,500 | .64 | † |
| R3 | R060105 | 1-2 | 1,500 | .84 | † |
| R3 | R060108 | 1-4 | 1,800 | .55 | .77 |
| R4 | R060301 | 1-2 | 1,500 | .73 | † |
| R4 | R060305 | 1-3 | 1,500 | .68 | .75 |
| R4 | R060306 | 1-4 | 1,800 | .54 | .62 |
| R4 | R060309 | 1-3 | 1,400 | .61 | .69 |
| R5 | R058504 | 1-3 | 1,400 | .58 | .66 |
| R5 | R058508 | 1-4 | 1,500 | .56 | .77 |
| R5 | R058509 | 1-2 | 1,500 | .80 | † |
| R6 | R058602 | 1-3 | 1,400 | .68 | .76 |
| R6 | R058606 | 1-3 | 1,500 | .77 | .81 |
| R6 | R058608 | 1-4 | 1,400 | .64 | .84 |
| R7 | R058805 | 1-3 | 1,900 | .65 | .74 |
| R7 | R058807 | 1-4 | 1,400 | .65 | .83 |
| R7 | R058810 | 1-3 | 1,500 | .65 | .72 |
| R8 | R059106 | 1-4 | 2,000 | .46 | .69 |
| R8 | R059108 | 1-3 | 1,500 | .73 | .84 |
| R8 | R059109 | 1-3 | 1,500 | .60 | .74 |
| R8 | R059110 | 1-2 | 1,600 | .79 | † |
| R9 | R060503 | 1-3 | 1,400 | .85 | .91 |
| R9 | R060505 | 1-4 | 1,400 | .71 | .88 |
| R9 | R060507 | 1-3 | 1,600 | .44 | .49 |
| R9 | R060508 | 1-3 | 2,900 | .55 | .63 |
| R9 | R060509 | 1-3 | 1,400 | .70 | .80 |
| R10 | R060603 | 1-3 | 1,400 | .65 | .77 |
| R10 | R060605 | 1-3 | 1,500 | .73 | .78 |
| R10 | R060606 | 1-4 | 1,400 | .58 | .77 |
| R10 | R060607 | 1-3 | 1,500 | .59 | .67 |
| R10 | R060608 | 1-3 | 1,500 | .82 | .88 |
| R12 | R061003 | 1-3 | 1,500 | .73 | .82 |
| R12 | R061004 | 1-2 | 1,500 | .81 | † |
| R12 | R061006 | 1-2 | 1,400 | .80 | † |
| R12 | R061007 | 1-4 | 1,400 | .44 | .59 |
| R12 | R061010 | 1-3 | 1,400 | .55 | .67 |
| † The Intraclass correlation is not reported for dichotomously scored items. NOTE:The intraclass correlation is most appropriate for items with more than two categories. Cohen"s Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including blank, off-task, and not-scorable were not included in the calculation of Cohen's Kappa or intraclass correlation. |
|||||