Skip to main content
NAEP Scoring → Scoring Monitoring → Within-Year Interrater Agreement → Mathematics Interrater Agreement → Item-by-Item Interrater Agreement, Mathematics Assessment, by Grade: 2009

NAEP Technical DocumentationItem-by-item interrater agreement, mathematics assessment, by grade: 2009
Grade Item Part Number of responses scored Score points Agreement
† Not applicable.
NOTE: Separate statistics are provided for each part of multi-part items. Item = identifier for each NAEP question; Score points = number of score levels for an item; Agreement = percent exact agreement between first and second scores. Items with "EN" (English) and "SP" (Spanish) at the end of the identifier were in bilingual booklets in which the student has the option of answering in whichever language he/she prefers.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2009 Mathematics Assessment.
4 09B1M10_04 † 33,981 2 99
09B1M10_04EN † 522 2 100
09B1M10_04SP † 522 2 100
09B1M10_11 † 33,981 2 96
09B1M10_11EN † 522 2 98
09B1M10_11SP † 522 2 97
09B1M10_13 † 33,981 3 88
09B1M10_13EN † 522 3 98
09B1M10_13SP † 522 3 88
09B1M10_16 † 33,981 5 91
09B1M10_16EN † 522 5 99
09B1M10_16SP † 522 5 92
09B1M6_10 † 33,728 2 100
09B1M6_10EN † 522 2 90
09B1M6_10SP † 522 2 100
09B1M6_11 † 33,728 3 94
09B1M6_11EN † 522 3 96
09B1M6_11SP † 522 3 93
09B1M6_14 † 33,728 3 96
09B1M6_14EN † 522 3 100
09B1M6_14SP † 522 3 100
09D1M12_04 † 34,061 3 99
09D1M12_04EN † 428 3 100
09D1M12_04SP † 428 3 100
09D1M12_11 † 34,061 3 96
09D1M12_11EN † 428 3 98
09D1M12_11SP † 428 3 99
09D1M12_12 † 34,061 2 98
09D1M12_12EN † 428 2 100
09D1M12_12SP † 428 2 99
09D1M12_16 † 34,061 5 94
09D1M12_16EN † 428 5 99
09D1M12_16SP † 428 5 94
09D1M3_08 † 33,523 3 98
09D1M3_10 † 33,523 2 98
09D1M3_12 † 33,523 3 98
09D1M3_13 † 33,523 3 98
09D1M3_15 † 33,523 5 88
09D1M4_02 † 33,633 2 100
09D1M4_03 † 33,633 3 99
09D1M4_04 † 33,633 3 94
09D1M4_15 † 33,633 3 87
09F1M11_04 † 33,736 3 98
09F1M11_06 † 33,736 3 96
09F1M11_11 † 33,736 3 98
09F1M11_13 † 33,736 3 98
09F1M11_15 † 33,736 3 98
09F1M11_16 Part A 33,736 2 99
09F1M11_16 Part B 33,736 3 95
09F1M7_03 † 33,492 2 99
09F1M7_07 † 33,492 2 99
09F1M7_08 † 33,492 3 99
09F1M7_11 † 33,492 3 99
09F1M7_13 † 33,492 3 86
09F1M7_15 † 33,492 4 96
09F1M9_04 † 33,530 3 94
09F1M9_09 † 33,530 3 99
09F1M9_12 † 33,530 3 89
09F1M9_15 † 33,530 3 96
09F1M9_16 † 33,530 5 96
09Z12M5A_03 † 33,695 3 98
09Z12M5A_04 † 33,695 3 96
09Z12M5A_06 † 33,695 5 90
09Z12M5A_07 † 33,695 2 99
09Z12M5A_08 † 33,695 2 99
09Z12M5A_12 † 33,695 3 97
09Z12M5A_14 † 33,695 3 97
09Z12M5A_15 † 33,695 3 98
09Z1M8_05 † 33,743 3 99
09Z1M8_05EN † 428 3 99
09Z1M8_05SP † 428 3 99
09Z1M8_11 † 33,743 3 97
09Z1M8_11EN † 428 3 99
09Z1M8_11SP † 428 3 96
09Z1M8_13 † 33,743 3 97
09Z1M8_13EN † 428 3 100
09Z1M8_13SP † 428 3 99
09Z1M8_15 † 33,743 3 92
09Z1M8_15EN † 428 3 97
09Z1M8_15SP † 428 3 98
09Z1M8_17 † 33,743 3 96
09Z1M8_17EN † 428 3 99
09Z1M8_17SP † 428 3 99
09Z1M8_19 † 33,743 5 96
09Z1M8_19EN † 428 5 100
09Z1M8_19SP † 428 5 98
8 09B2M10_09 † 32,538 2 99
09B2M10_09EN † 159 2 100
09B2M10_09SP † 159 2 100
09B2M10_13 † 32,538 2 100
09B2M10_13EN † 159 2 98
09B2M10_13SP † 159 2 98
09B2M10_16 † 32,538 5 89
09B2M10_16EN † 159 5 98
09B2M10_16SP † 159 5 95
09B2M6_10 † 32,207 3 96
09B2M6_10EN † 159 3 100
09B2M6_10SP † 159 3 100
09B2M6_13 † 32,207 2 88
09B2M6_13EN † 159 2 100
09B2M6_13SP † 159 2 98
09B2M6_16 † 32,207 5 89
09B2M6_16EN † 159 5 100
09B2M6_16SP † 159 5 100
09D2M12_06 † 32,638 3 92
09D2M12_06EN † 127 3 100
09D2M12_06SP † 127 3 97
09D2M12_10 † 32,638 2 99
09D2M12_10EN † 127 2 100
09D2M12_10SP † 127 2 97
09D2M12_13 † 32,638 3 92
09D2M12_13EN † 127 3 100
09D2M12_13SP † 127 3 94
09D2M3_02 † 32,398 3 97
09D2M3_11 † 32,398 3 97
09D2M3_12 † 32,398 2 99
09D2M3_15 † 32,398 2 99
09D2M4_0304 Item 3 32,202 3 93
09D2M4_0304 Item 4 32,202 3 95
09D2M4_14 † 32,202 5 98
09F2M11_01 † 32,562 3 95
09F2M11_09 † 32,562 3 95
09F2M11_11 † 32,562 3 96
09F2M11_15 † 32,562 3 97
09F2M11_17 † 32,562 3 98
09F2M7_04 † 32,237 3 99
09F2M7_09 † 32,237 3 97
09F2M7_12 † 32,237 3 96
09F2M7_14 † 32,237 2 93
09F2M7_16 Part A 32,237 2 98
09F2M7_16 Part B 32,237 2 99
09F2M7_16 Part C 32,237 3 95
09F2M8_06 † 32,357 3 99
09F2M8_06EN † 128 3 100
09F2M8_06SP † 128 3 97
09F2M8_09 † 32,357 3 96
09F2M8_09EN † 128 3 100
09F2M8_09SP † 128 3 94
09F2M8_11 † 32,357 3 91
09F2M8_11EN † 128 3 100
09F2M8_11SP † 128 3 97
09F2M8_15 Part A 32,357 2 99
09F2M8_15 Part B 32,357 2 100
09F2M8_15 Part C 32,357 3 95
09F2M8_15 Part D 32,357 2 96
09F2M8_15EN Part A 128 2 100
09F2M8_15EN Part B 128 2 100
09F2M8_15EN Part C 128 3 100
09F2M8_15EN Part D 128 2 100
09F2M8_15SP Part A 128 2 97
09F2M8_15SP Part B 128 2 100
09F2M8_15SP Part C 128 3 100
09F2M8_15SP Part D 128 2 100
09F2M9_05 † 32,471 2 99
09F2M9_08 † 32,471 3 98
09F2M9_11 † 32,471 2 97
09F2M9_13 † 32,471 3 99
09F2M9_15 Part A 32,471 3 98
09F2M9_15 Part B 32,471 3 93
09Z12M5B_01 † 32,342 3 99
09Z12M5B_02 † 32,342 3 97
09Z12M5B_06 † 32,342 2 100
09Z12M5B_07 † 32,342 2 99
09Z12M5B_11 † 32,342 3 96
09Z12M5B_13 † 32,342 3 98
09Z12M5B_14 † 32,342 3 98
09Z12M5B_17 † 32,342 3 99
09Z12M5B_18 † 32,342 5 91
12 09F3M1_03 † 6,436 3 98
09F3M1_07 † 6,436 3 96
09F3M1_10 † 6,436 2 98
09F3M1_12 Part A 6,436 3 93
09F3M1_12 Part B 6,436 3 87
09F3M1_14 † 6,436 3 98
09F3M10_03 † 6,453 3 99
09F3M10_06 † 6,453 3 100
09F3M10_08 † 6,453 3 99
09F3M10_11 † 6,453 3 98
09F3M10_13 Part A 6,453 3 97
09F3M10_13 Part B 6,453 2 98
09F3M10_13 Part C 6,453 2 99
09F3M11_05 † 6,474 2 99
09F3M11_06 † 6,474 3 98
09F3M11_07 † 6,474 2 100
09F3M11_10 Part A 6,474 3 96
09F3M11_10 Part B 6,474 2 95
09F3M11_10 Part C 6,474 2 97
09F3M11_10 Part D 6,474 2 96
09F3M11_13 † 6,474 2 99
09F3M12_03 † 6,385 2 99
09F3M12_09 † 6,385 2 100
09F3M12_11 † 6,385 3 97
09F3M12_14 † 6,385 4 97
09F3M2_04 † 6,361 3 92
09F3M2_07 † 6,361 3 98
09F3M2_09 Part A 6,361 3 94
09F3M2_09 Part B 6,361 3 90
09F3M2_09 Part C 6,361 3 95
09F3M2_12 † 6,361 3 98
09F3M2_14 † 6,361 3 98
09F3M3_06 † 6,423 2 98
09F3M3_07 † 6,423 2 99
09F3M3_08 † 6,423 3 92
09F3M3_10 Part A 6,423 3 93
09F3M3_10 Part B 6,423 3 96
09F3M3_10 Part C 6,423 3 97
09F3M3_14 † 6,423 3 96
09F3M4_01 † 6,499 2 99
09F3M4_02 Part A 6,499 2 99
09F3M4_02 Part B 6,499 2 99
09F3M4_02 Part C 6,499 2 98
09F3M4_03 Part A 6,499 2 99
09F3M4_03 Part B 6,499 2 99
09F3M4_04 † 6,499 3 90
09F3M4_08 † 6,499 3 95
09F3M4_11 † 6,499 3 96
09F3M5_03 † 6,436 3 90
09F3M5_08 † 6,436 5 97
09F3M5_11 † 6,436 3 98
09F3M5_13 † 6,436 2 99
09F3M6_06 † 6,396 3 96
09F3M6_08 † 6,396 3 97
09F3M6_10 † 6,396 5 99
09F3M6_12 † 6,396 2 96
09F3M7_03 † 6,450 3 98
09F3M7_07 † 6,450 5 96
09F3M7_10 † 6,450 3 98
09F3M7_12 † 6,450 2 99
09F3M7_13 † 6,450 3 96
09F3M8_03 † 6,375 2 100
09F3M8_06 † 6,375 5 98
09F3M8_09 † 6,375 3 97
09F3M8_11 Part A 6,375 2 100
09F3M8_11 Part B 6,375 2 100
09F3M8_13 † 6,375 3 90
09F3M9_03 † 6,423 2 100
09F3M9_08 † 6,423 5 94
09F3M9_12 † 6,423 3 97
09B23M8C_07 † 2,124 2 100
09B23M8C_09 † 2,124 2 94
09B23M8C_11 † 2,124 3 98
09B23M8C_13 † 2,124 3 97
09B23M8C_15 † 2,124 3 96
09B23M8C_17 † 2,124 4 98
09B23M8C_18 † 2,124 2 97
09B23M8C_19 † 2,124 3 98
09B23M8C_20 † 2,124 3 98
09B23M8C_21 † 2,124 5 98
09B23M9C_02 † 2,194 2 94
09B23M9C_03 † 2,194 2 100
09B23M9C_10 † 2,194 3 97
09B23M9C_12 † 2,194 3 97
09B23M9C_13 † 2,194 3 98
09B23M9C_15 † 2,194 2 99
09B23M9C_16 † 2,194 3 99
09B23M9C_18 † 2,194 3 98
09B23M9C_19 † 2,194 2 98
09B23M9C_20 † 2,194 5 96
09B3M10_03 † 2,257 3 93
09B3M10_05 † 2,257 2 99
09B3M10_06 † 2,257 2 98
09B3M10_12 † 2,257 3 95
09B3M10_16 † 2,257 2 96
09B3M10_17 † 2,257 2 99
09B3M10_18 † 2,257 5 85
09B3M11_06 † 2,232 2 99
09B3M11_13 † 2,232 2 100
09B3M11_18 † 2,232 5 93
09B3M12_03 † 2,193 2 98
09B3M12_12 † 2,193 4 97
09B3M12_18 † 2,193 5 94
09B3M3_04 † 2,195 3 92
09B3M3_09 † 2,195 3 95
09B3M3_14 † 2,195 2 99
09B3M3_16 † 2,195 3 98
09B3M3_17 † 2,195 4 96
09B3M4_02 † 2,210 3 95
09B3M4_050607 Item 5 2,210 3 92
09B3M4_050607 Item 6 2,210 3 93
09B3M4_050607 Item 7 2,210 3 93
09B3M4_12 † 2,210 3 98
09B3M4_15 † 2,210 2 100
09B3M4_18 † 2,210 5 94
09B3M5_03 † 2,217 4 89
09B3M5_04 † 2,217 3 96
09B3M5_05 † 2,217 2 99
09B3M5_08 † 2,217 2 97
09B3M5_09 † 2,217 2 99
09B3M5_17 † 2,217 3 96
09B3M5_19 † 2,217 5 82
09B3M6_13 † 2,085 2 99
09B3M6_15 † 2,085 4 93
09B3M6_16 † 2,085 3 95
09B3M7_03 † 2,260 3 99
09B3M7_06 † 2,260 3 98
09B3M7_16 † 2,260 3 97
09B3M7_17 † 2,260 3 99
09B3M7_18 † 2,260 5 93

Last updated 16 July 2014 (GF)