Table of Contents | Search Technical Documentation | References

NAEP Scoring → Within-Year Interrater Agreement → Mathematics Interrater Agreement → Item-by-Item Interrater Agreement, Mathematics Assessment, By Grade: 2013
NAEP Technical DocumentationItem-by-item interrater agreement, mathematics assessment, by grade: 2013
Grade NAEP ID Part Number of responses scored Score points Agreement
4 13D1M3_08 † 35,218 3 97
13D1M3_10 † 35,218 2 97
13D1M3_12 † 35,218 3 97
13D1M3_13 † 35,218 3 96
13D1M3_15 † 35,218 5 87
13D1M4_02 † 36,761 2 100
13D1M4_03 † 36,761 3 98
13D1M4_04 † 36,761 3 94
13D1M4_15 † 36,761 3 89
13H1M5_02 † 36,595 2 99
13H1M5_04 Part A 36,595 2 99
13H1M5_04 Part B 36,595 3 96
13H1M5_07 † 36,595 2 98
13H1M5_08 † 36,595 2 99
13H1M5_14 † 36,595 3 93
13B1M6_10 † 35,256 2 99
13B1M6_11 † 35,256 3 93
13B1M6_14 † 35,256 3 96
13F1M7_03 † 37,660 2 99
13F1M7_07 † 37,660 2 99
13F1M7_08 † 37,660 3 99
13F1M7_11 † 37,660 3 99
13F1M7_13 † 37,660 3 82
13F1M7_15 † 37,660 4 96
13H1M10_04 † 36,836 3 99
13H1M10_08 † 36,836 3 95
13H1M10_11 † 36,836 3 92
13H1M10_15 † 36,836 3 97
13F1M11_04 † 36,604 3 98
13F1M11_06 † 36,604 3 96
13F1M11_11 † 36,604 3 97
13F1M11_13 † 36,604 3 99
13F1M11_15 † 36,604 3 98
13F1M11_16 Part A 36,604 2 99
13F1M11_16 Part B 36,604 3 96
13J1M8_05 † 39,383 2 99
13J1M8_09 † 39,383 2 99
13J1M8_13 Part A 39,383 2 97
13J1M8_13 Part B 39,383 2 98
13J1M8_13 Part C 39,383 2 98
13J1M8_15 † 39,383 2 100
13J1M9_03 † 36,713 3 99
13J1M9_06 † 36,713 3 98
13J1M9_10 † 36,713 3 98
13J1M9_12 † 36,713 2 97
13J1M9_14 † 36,713 2 100
13J1M12_03 † 35,538 3 99
13J1M12_07 † 35,538 3 99
13J1M12_12 † 35,538 3 97
13H1M5_02SP † 356 2 98
13H1M5_02EN † 356 2 100
13H1M5_04SP Part A 356 2 100
13H1M5_04SP Part B 356 3 99
13H1M5_04EN Part A 356 2 100
13H1M5_04EN Part B 356 3 99
13H1M5_07SP † 356 2 94
13H1M5_07EN † 356 2 86
13H1M5_08SP † 356 2 99
13H1M5_08EN † 356 2 98
13H1M5_14SP † 356 3 100
13H1M5_14EN † 356 3 99
13JB1M6_10SP † 386 2 99
13JB1M6_10EN † 386 2 98
13JB1M6_11SP † 386 3 96
13JB1M6_11EN † 386 3 95
13JB1M6_14SP † 386 3 99
13JB1M6_14EN † 386 3 95
13H1M10_04SP † 355 3 100
13H1M10_04EN † 355 3 100
13H1M10_08SP † 355 3 99
13H1M10_08EN † 355 3 99
13H1M10_11SP † 355 3 90
13H1M10_11EN † 355 3 100
13H1M10_15SP † 355 3 99
13H1M10_15EN † 355 3 99
13JF1M11_04SP † 386 3 98
13JF1M11_04EN † 386 3 99
13JF1M11_06SP † 386 3 97
13JF1M11_06EN † 386 3 99
13JF1M11_11SP † 386 3 97
13JF1M11_11EN † 386 3 97
13JF1M11_13SP † 386 3 98
13JF1M11_13EN † 386 3 100
13JF1M11_15SP † 386 3 100
13JF1M11_15EN † 386 3 100
13JF1M11_16SP Part A 386 2 100
13JF1M11_16SP Part B 386 3 98
13JF1M11_16EN Part A 386 2 99
13JF1M11_16EN Part B 386 3 98
13D1M3_08S † 478 3 99
13D1M3_10S † 478 2 95
13D1M3_12S † 478 3 98
13D1M3_13S † 478 3 96
13D1M3_15S † 478 5 98
13D1M4_02S † 459 2 99
13D1M4_03S † 459 3 99
13D1M4_04S † 459 3 97
13D1M4_15S † 459 3 96
13H1M5_02S † 396 2 99
13H1M5_04S Part A 396 2 100
13H1M5_04S Part B 396 3 96
13H1M5_07S † 396 2 94
13H1M5_08S † 396 2 99
13H1M5_14S † 396 3 99
13B1M6_10S † 380 2 98
13B1M6_11S † 380 3 98
13B1M6_14S † 380 3 97
13F1M7_03S † 423 2 100
13F1M7_07S † 423 2 98
13F1M7_08S † 423 3 99
13F1M7_11S † 423 3 98
13F1M7_13S † 423 3 95
13F1M7_15S † 423 4 99
13J1M8_05S † 518 2 99
13J1M8_09S † 518 2 100
13J1M8_13S Part A 518 2 97
13J1M8_13S Part B 518 2 100
13J1M8_13S Part C 518 2 97
13J1M8_15S † 518 2 100
13J1M9_03S † 360 3 97
13J1M9_06S † 360 3 100
13J1M9_10S † 360 3 100
13J1M9_12S † 360 2 98
13J1M9_14S † 360 2 99
13H1M10_04S † 293 3 99
13H1M10_08S † 293 3 100
13H1M10_11S † 293 3 95
13H1M10_15S † 293 3 97
13F1M11_04S † 283 3 97
13F1M11_06S † 283 3 97
13F1M11_11S † 283 3 96
13F1M11_13S † 283 3 97
13F1M11_15S † 283 3 100
13F1M11_16S Part A 283 2 100
13F1M11_16S Part B 283 3 97
13J1M12_03S † 301 3 100
13J1M12_07S † 301 3 100
13J1M12_12S † 301 3 99
8 13D2M3_02 † 33,260 3 98
13D2M3_11 † 33,260 3 97
13D2M3_12 † 33,260 2 99
13D2M3_15 † 33,260 2 99
13D2M4_0304 Item 3 34,620 3 94
13D2M4_0304 Item 4 34,620 3 95
13D2M4_14 † 34,620 5 98
13H2M5_03 † 34,348 3 99
13H2M5_04 † 34,348 3 84
13H2M5_09 † 34,348 2 99
13H2M5_15 † 34,348 3 99
13H2M10_04 † 34,503 3 99
13H2M10_08 † 34,503 3 99
13H2M10_10 † 34,503 3 91
13H2M10_15 † 34,503 3 99
13B2M6_10 † 33,218 3 95
13B2M6_13 † 33,218 2 93
13B2M6_16 † 33,218 5 92
13HF2M7_04 † 37,397 3 99
13HF2M7_09 † 37,397 3 97
13HF2M7_12 † 37,397 3 94
13HF2M7_14 † 37,397 2 95
13HF2M7_16 Part A 37,397 2 99
13HF2M7_16 Part B 37,397 2 99
13HF2M7_16 Part C 37,397 3 96
13F2M11_01 † 34,366 3 96
13F2M11_09 † 34,366 3 96
13F2M11_11 † 34,366 3 96
13F2M11_15 † 34,366 3 97
13F2M11_17 † 34,366 3 99
13J2M8_05 † 34,819 3 99
13J2M8_08 † 34,819 3 99
13J2M8_15 Part A 34,819 3 98
13J2M8_15 Part B 34,819 3 94
13J2M9_07 † 38,764 2 99
13J2M9_12 † 38,764 3 99
13J2M9_15 Part A 38,764 2 99
13J2M9_15 Part B 38,764 3 99
13J2M9_15 Part C 38,764 3 98
13J2M9_15 Part D 38,764 3 98
13J2M12_05 † 34,524 2 99
13J2M12_07 † 34,524 2 100
13J2M12_11 † 34,524 2 98
13J2M12_15 † 34,524 3 90
13JB2M6_10SP † 143 3 98
13JB2M6_10EN † 143 3 98
13JB2M6_13SP † 143 2 97
13JB2M6_13EN † 143 2 100
13JB2M6_16SP † 143 5 94
13JB2M6_16EN † 143 5 97
13JF2M11_01SP † 143 3 97
13JF2M11_01EN † 143 3 97
13JF2M11_09SP † 143 3 98
13JF2M11_09EN † 143 3 99
13JF2M11_11SP † 143 3 96
13JF2M11_11EN † 143 3 97
13JF2M11_15SP † 143 3 99
13JF2M11_15EN † 143 3 99
13JF2M11_17SP † 143 3 98
13JF2M11_17EN † 143 3 99
13H2M5_03SP † 130 3 100
13H2M5_03EN † 130 3 100
13H2M5_04SP † 130 3 95
13H2M5_04EN † 130 3 99
13H2M5_09SP † 130 2 100
13H2M5_09EN † 130 2 100
13H2M5_15SP † 130 3 100
13H2M5_15EN † 130 3 99
13H2M10_04SP † 130 3 98
13H2M10_04EN † 130 3 98
13H2M10_08SP † 130 3 99
13H2M10_08EN † 130 3 100
13H2M10_10SP † 130 3 98
13H2M10_10EN † 130 3 99
13H2M10_15SP † 130 3 99
13H2M10_15EN † 130 3 100
13JD2M3_02S † 463 3 96
13JD2M3_11S † 463 3 100
13JD2M3_12S † 463 2 99
13JD2M3_15S † 463 2 100
13D2M4_0304S Item 3 457 3 100
13D2M4_0304S Item 4 457 3 100
13D2M4_14S † 457 5 97
13B2M6_10S † 465 3 98
13B2M6_13S † 465 2 97
13B2M6_16S † 465 5 96
13JH2M5_03S † 460 3 99
13JH2M5_04S † 460 3 94
13JH2M5_09S † 460 2 97
13JH2M5_15S † 460 3 99
13H2M10_04S † 327 3 98
13H2M10_08S † 327 3 100
13H2M10_10S † 327 3 90
13H2M10_15S † 327 3 99
13JF2M7_04S † 575 3 97
13JF2M7_09S † 575 3 97
13JF2M7_12S † 575 3 99
13JF2M7_14S † 575 2 99
13JF2M7_16S Part A 575 2 99
13JF2M7_16S Part B 575 2 99
13JF2M7_16S Part C 575 3 97
13F2M11_01S † 330 3 96
13F2M11_09S † 330 3 96
13F2M11_11S † 330 3 100
13F2M11_15S † 330 3 100
13F2M11_17S † 330 3 100
13J2M8_05S † 763 3 95
13J2M8_08S † 763 3 100
13J2M8_15S Part A 763 3 98
13J2M8_15S Part B 763 3 99
13J2M9_07S † 428 2 100
13J2M9_12S † 428 3 97
13J2M9_15S Part A 428 2 100
13J2M9_15S Part B 428 3 100
13J2M9_15S Part C 428 3 98
13J2M9_15S Part D 428 3 100
13J2M12_05S † 336 2 100
13J2M12_07S † 336 2 99
13J2M12_11S † 336 2 98
13J2M12_15S † 336 3 96
12 13F3M1_03 † 7,524 3 98
13F3M1_07 † 7,524 3 97
13F3M1_10 † 7,524 2 98
13F3M1_12 Part A 7,524 3 91
13F3M1_12 Part B 7,524 3 86
13F3M1_14 † 7,524 3 96
13F3M3_06 † 7,400 2 99
13F3M3_07 † 7,400 2 99
13F3M3_08 † 7,400 3 93
13F3M3_10 Part A 7,400 3 92
13F3M3_10 Part B 7,400 3 96
13F3M3_10 Part C 7,400 3 96
13F3M3_14 † 7,400 3 97
13F3M4_01 † 7,470 2 99
13F3M4_02 Part A 7,470 2 98
13F3M4_02 Part B 7,470 2 98
13F3M4_02 Part C 7,470 2 98
13F3M4_03 Part A 7,470 2 99
13F3M4_03 Part B 7,470 2 99
13F3M4_04 † 7,470 3 89
13F3M4_08 † 7,470 3 94
13F3M4_11 † 7,470 3 98
13F3M5_03 † 7,452 3 89
13F3M5_08 † 7,452 5 98
13F3M5_11 † 7,452 3 99
13F3M5_13 † 7,452 2 99
13F3M6_06 † 7,462 3 97
13F3M6_08 † 7,462 3 95
13F3M6_10 † 7,462 5 98
13F3M6_12 † 7,462 2 96
13F3M8_03 † 7,705 2 100
13F3M8_06 † 7,705 5 98
13F3M8_09 † 7,705 3 95
13F3M8_11 Part A 7,705 2 100
13F3M8_11 Part B 7,705 2 99
13F3M8_13 † 7,705 3 93
13F3M9_03 † 7,377 2 100
13F3M9_08 † 7,377 5 95
13F3M9_12 † 7,377 3 96
13F3M10_03 † 7,750 3 98
13F3M10_06 † 7,750 3 99
13F3M10_08 † 7,750 3 99
13F3M10_11 † 7,750 3 98
13F3M10_13 Part A 7,750 3 98
13F3M10_13 Part B 7,750 2 98
13F3M10_13 Part C 7,750 2 99
13F3M11_05 † 7,254 2 99
13F3M11_06 † 7,254 3 99
13F3M11_07 † 7,254 2 100
13F3M11_10 Part A 7,254 3 97
13F3M11_10 Part B 7,254 2 95
13F3M11_10 Part C 7,254 2 96
13F3M11_10 Part D 7,254 2 94
13F3M11_13 † 7,254 2 99
13F3M12_03 † 7,230 2 100
13F3M12_09 † 7,230 2 99
13F3M12_11 † 7,230 3 97
13F3M12_14 † 7,230 4 98
13J3M2_04 † 7,432 3 90
13J3M2_07 † 7,432 3 97
13J3M2_11 Part A 7,432 2 98
13J3M2_11 Part B 7,432 2 99
13J3M2_11 Part C 7,432 2 99
13J3M2_14 † 7,432 3 91
13J3M7_04 † 7,425 2 99
13J3M7_08 † 7,425 3 98
13J3M7_13 † 7,425 4 95
13J3M13_03 † 7,157 3 100
13J3M13_07 † 7,157 2 99
13J3M13_09 † 7,157 2 100
13J3M13_13 † 7,157 4 98
13J3M14_05 † 7,386 2 100
13J3M14_08 † 7,386 3 99
13J3M14_12 Part A 7,386 3 99
13J3M14_12 Part B 7,386 3 96
† Not applicable.
NOTE: Separate statistics are provided for each part of multi-part items. Item = identifier for each NAEP question; Score points = number of score levels for an item; Agreement = percent exact agreement between first and second scores. Items with "EN" (English) and "SP" (Spanish) at the end of the identifier were in bilingual booklets in which the student has the option of answering in whichever language he/she prefers. Items with "S" (Spanish) at the end of the identifier were in Spanish language booklets. 
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2013 Mathematics Assessment.
Last updated 13 June 2017 (DC)
Back to Top