NAEP Scoring → Scoring Monitoring → Within-Year Interrater Agreement → Science Interrater Agreement → Item-by-Item Interrater Agreement, Science Assessment, by Grade: 2009

NAEP Technical DocumentationItem-by-item interrater agreement, science assessment, by grade: 2009
Grade Item Part Number of responses scored Score points Agreement
† Not applicable.
NOTE: Separate statistics are provided for each part of multi-part items. Item = identifier for each NAEP question; Score points = number of score levels for an item; Agreement = percent exact agreement between first and second scores. Items with "EN" (English) and "SP" (Spanish) at the end of the identifier were in bilingual booklets in which the student has the option of answering in whichever language he/she prefers.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2009 Science Assessment.
4 09F1S10_03 Part A 34,688 3 95
09F1S10_03 Part B 34,688 3 94
09F1S10_03 Part C 34,688 3 95
09F1S10_05 † 34,688 3 93
09F1S10_10 † 34,688 3 86
09F1S10_14 † 34,688 3 90
09F1S10_15 † 34,688 4 91
09F1S11_04 † 34,164 2 95
09F1S11_08 † 34,164 5 84
09F1S11_09 † 34,164 3 92
09F1S11_11 † 34,164 3 93
09F1S11_14 † 34,164 3 95
09F1S21_01 † 2,151 5 98
09F1S21_02 Part A 2,151 4 78
09F1S21_02 Part B 2,151 4 78
09F1S21_03 Part A 2,151 4 85
09F1S21_03 Part B 2,151 4 82
09F1S21_04 † 2,151 3 84
09F1S21_05 † 2,151 4 92
09F1S22_01 † 2,151 3 95
09F1S22_02 † 2,151 3 93
09F1S22_03 † 2,151 4 93
09F1S22_04 Part A 2,151 2 100
09F1S22_04 Part B 2,151 2 99
09F1S22_04 Part C 2,151 2 99
09F1S22_05 † 2,151 4 92
09F1S22_06 † 2,151 3 87
09F1S22_07 Part A 2,151 3 98
09F1S22_07 Part B 2,151 3 98
09F1S22_08 † 2,151 3 97
09F1S25EXT_05 † 1,906 4 80
09F1S25EXT_07 † 1,898 4 88
09F1S25EXT_08 † 1,898 4 89
09F1S25EXT_09 † 1,868 3 89
09F1S25EXT_11 † 1,831 3 82
09F1S26_01 † 2,002 2 100
09F1S26_02 † 2,002 3 99
09F1S26_03 † 2,002 2 99
09F1S26_04 † 2,002 3 94
09F1S26_05 † 2,002 4 87
09F1S26_06 † 2,000 4 87
09F1S26_07 † 2,000 4 89
09F1S26_08 Part A 2,000 3 94
09F1S26_08 Part B 2,000 3 90
09F1S26_08 Part C 2,000 3 92
09F1S27_01 Part A 1,999 3 99
09F1S27_01 Part B 1,999 3 99
09F1S27_02 Part A 1,999 3 98
09F1S27_02 Part B 1,999 3 99
09F1S27_05 † 1,999 3 90
09F1S27_06 † 1,999 4 88
09F1S27_07 † 1,996 4 94
09F1S3_03 † 36,238 4 88
09F1S3_03EN † 460 4 97
09F1S3_03SP † 460 4 85
09F1S3_07 † 36,238 3 90
09F1S3_07EN † 460 3 97
09F1S3_07SP † 460 3 89
09F1S3_10 † 36,238 3 87
09F1S3_10EN † 460 3 97
09F1S3_10SP † 460 3 91
09F1S3_13 † 36,238 4 91
09F1S3_13EN † 460 4 97
09F1S3_13SP † 460 4 91
09F1S3_15 † 36,238 3 87
09F1S3_15EN † 460 3 97
09F1S3_15SP † 460 3 90
09F1S4_04 † 34,609 3 96
09F1S4_04EN † 460 3 99
09F1S4_04SP † 460 3 97
09F1S4_05 † 34,609 2 93
09F1S4_05EN † 460 2 98
09F1S4_05SP † 460 2 86
09F1S4_06 † 34,609 2 94
09F1S4_06EN † 460 2 99
09F1S4_06SP † 460 2 85
09F1S4_08 † 34,609 3 89
09F1S4_08EN † 460 3 96
09F1S4_08SP † 460 3 91
09F1S4_10 † 34,609 4 90
09F1S4_10EN † 460 4 100
09F1S4_10SP † 460 4 92
09F1S5_03 † 34,494 3 94
09F1S5_03EN † 462 3 98
09F1S5_03SP † 462 3 96
09F1S5_04 † 34,494 3 90
09F1S5_04EN † 462 3 93
09F1S5_04SP † 462 3 82
09F1S5_05 † 34,494 3 89
09F1S5_05EN † 462 3 98
09F1S5_05SP † 462 3 82
09F1S5_14 † 34,494 3 91
09F1S5_14EN † 462 3 97
09F1S5_14SP † 462 3 90
09F1S5_16 † 34,494 3 94
09F1S5_16EN † 462 3 99
09F1S5_16SP † 462 3 97
09F1S6_06 † 34,514 3 89
09F1S6_06EN † 462 3 99
09F1S6_06SP † 462 3 94
09F1S6_08 Part A 34,514 2 99
09F1S6_08 Part B 34,514 2 100
09F1S6_08 Part C 34,514 2 100
09F1S6_08 Part D 34,514 2 100
09F1S6_08EN Part A 462 2 100
09F1S6_08EN Part B 462 2 100
09F1S6_08EN Part C 462 2 100
09F1S6_08EN Part D 462 2 100
09F1S6_08SP Part A 462 2 97
09F1S6_08SP Part B 462 2 97
09F1S6_08SP Part C 462 2 96
09F1S6_08SP Part D 462 2 97
09F1S6_10 † 34,514 3 90
09F1S6_10EN † 462 3 98
09F1S6_10SP † 462 3 82
09F1S6_11 † 34,514 4 85
09F1S6_11EN † 462 4 98
09F1S6_11SP † 462 4 94
09F1S6_13 † 34,514 3 81
09F1S6_13EN † 462 3 100
09F1S6_13SP † 462 3 91
09F1S7_05 † 34,437 3 90
09F1S7_07 † 34,437 4 94
09F1S7_08 † 34,437 3 92
09F1S7_10 † 34,437 3 93
09F1S7_11 † 34,437 3 94
09F1S7_13 † 34,437 3 91
09F1S8_03 † 34,492 3 88
09F1S8_06 † 34,492 3 94
09F1S8_09 † 34,492 4 88
09F1S8_13 Part A 34,492 3 90
09F1S8_13 Part B 34,492 3 92
09F1S8_13 Part C 34,492 3 90
09F1S8_15 † 34,492 3 95
09F1S9_06 † 34,550 3 96
09F1S9_07 † 34,550 5 80
09F1S9_11 † 34,550 3 98
09F1S9_14 Part A 34,550 3 89
09F1S9_14 Part B 34,550 3 94
8 09F2S10_06 Part A 30,228 2 99
09F2S10_06 Part B 30,228 2 100
09F2S10_06 Part C 30,228 2 100
09F2S10_07 Part A 30,228 3 92
09F2S10_07 Part B 30,228 3 97
09F2S10_09 † 30,228 3 91
09F2S10_10 † 30,228 5 82
09F2S10_12 † 30,228 3 89
09F2S10_14 † 30,228 4 86
09F2S10_16 Part A 30,228 3 85
09F2S10_16 Part B 30,228 3 87
09F2S10_16 Part C 30,228 3 87
09F2S11_05 † 30,171 5 91
09F2S11_06 † 30,171 3 92
09F2S11_07 † 30,171 3 90
09F2S11_08 † 30,171 3 94
09F2S11_10 † 30,171 4 97
09F2S11_11 Part A 30,171 2 93
09F2S11_11 Part B 30,171 3 93
09F2S11_14 † 30,171 4 91
09F2S12_06 † 30,230 3 84
09F2S12_07 † 30,230 3 92
09F2S12_08 † 30,230 3 84
09F2S12_09 † 30,230 3 92
09F2S12_11 † 30,230 4 86
09F2S12_12 † 30,230 5 90
09F2S21_01 Part A 2,335 4 80
09F2S21_01 Part B 2,335 4 78
09F2S21_01 Part C 2,335 4 79
09F2S21_01 Part D 2,335 4 88
09F2S21_02 Part A 2,335 4 84
09F2S21_02 Part B 2,335 4 74
09F2S21_02 Part C 2,335 4 78
09F2S21_02 Part D 2,335 4 94
09F2S21_02 Part E 2,335 5 84
09F2S21_03 Part A 2,335 5 92
09F2S21_03 Part B 2,335 3 94
09F2S21_04 Part A 2,335 3 98
09F2S21_04 Part B 2,335 3 86
09F2S21_04 Part C 2,335 3 85
09F2S21_05 Part A 2,335 3 99
09F2S21_05 Part B 2,335 3 89
09F2S22_01 Part A 2,335 4 94
09F2S22_01 Part B 2,335 4 86
09F2S22_01 Part C 2,335 4 87
09F2S22_01 Part D 2,335 4 92
09F2S22_02 Part A 2,335 3 95
09F2S22_02 Part B 2,335 3 98
09F2S22_02 Part C 2,335 3 96
09F2S22_03 † 2,335 4 95
09F2S22_04 Part A 2,335 4 98
09F2S22_04 Part B 2,335 4 92
09F2S22_04 Part C 2,335 4 93
09F2S22_04 Part D 2,335 4 97
09F2S22_04 Part E 2,335 4 97
09F2S25EXT_05 † 2,079 3 87
09F2S25EXT_06 † 2,079 3 86
09F2S25EXT_07 † 2,074 3 88
09F2S25EXT_08 † 2,049 4 91
09F2S25EXT_0910 Item 09 1,921 3 92
09F2S25EXT_0910 Item 10 1,921 3 87
09F2S25EXT_11 † 1,633 3 92
09F2S26_01 † 2,133 3 85
09F2S26_02 † 2,132 3 83
09F2S26_03 Part A 2,132 2 100
09F2S26_03 Part B 2,132 2 98
09F2S26_03 Part C 2,132 2 99
09F2S26_03 Part D 2,132 2 98
09F2S26_05 † 2,132 3 86
09F2S27_02 † 2,131 4 89
09F2S27_03 † 2,131 4 77
09F2S27_04 † 2,131 4 87
09F2S27_05 † 2,130 4 93
09F2S27_06 † 2,130 4 86
09F2S3_03 † 30,427 3 89
09F2S3_03EN † 125 3 100
09F2S3_03SP † 125 3 97
09F2S3_06 † 30,427 5 86
09F2S3_06EN † 125 5 97
09F2S3_06SP † 125 5 91
09F2S3_07 † 30,427 4 92
09F2S3_07EN † 125 4 97
09F2S3_07SP † 125 4 97
09F2S3_14 † 30,427 5 80
09F2S3_14EN † 125 5 100
09F2S3_14SP † 125 5 100
09F2S3_15 † 30,427 4 96
09F2S3_15EN † 125 4 100
09F2S3_15SP † 125 4 100
09F2S4_02 † 30,386 5 89
09F2S4_02EN † 125 5 100
09F2S4_02SP † 125 5 91
09F2S4_11 † 30,386 4 84
09F2S4_11EN † 125 4 97
09F2S4_11SP † 125 4 94
09F2S4_13 † 30,386 3 92
09F2S4_13EN † 125 3 97
09F2S4_13SP † 125 3 91
09F2S4_15 † 30,386 3 87
09F2S4_15EN † 125 3 97
09F2S4_15SP † 125 3 97
09F2S4_16 † 30,386 5 85
09F2S4_16EN † 125 5 97
09F2S4_16SP † 125 5 81
09F2S5_05 † 30,287 4 95
09F2S5_05EN † 102 4 96
09F2S5_05SP † 102 4 100
09F2S5_08 † 30,287 3 89
09F2S5_08EN † 102 3 96
09F2S5_08SP † 102 3 96
09F2S5_09 † 30,287 4 92
09F2S5_09EN † 102 4 100
09F2S5_09SP † 102 4 100
09F2S5_10 † 30,287 3 87
09F2S5_10EN † 102 3 100
09F2S5_10SP † 102 3 85
09F2S5_15 † 30,287 5 88
09F2S5_15EN † 102 5 96
09F2S5_15SP † 102 5 92
09F2S6_04 † 30,292 4 90
09F2S6_04EN † 103 4 100
09F2S6_04SP † 103 4 96
09F2S6_05 † 30,292 3 90
09F2S6_05EN † 103 3 96
09F2S6_05SP † 103 3 92
09F2S6_07 † 30,292 5 79
09F2S6_07EN † 103 5 88
09F2S6_07SP † 103 5 81
09F2S6_10 † 30,292 3 90
09F2S6_10EN † 103 3 96
09F2S6_10SP † 103 3 100
09F2S6_14 † 30,292 3 89
09F2S6_14EN † 103 3 100
09F2S6_14SP † 103 3 96
09F2S6_15 † 30,292 3 85
09F2S6_15EN † 103 3 92
09F2S6_15SP † 103 3 96
09F2S7_04 Part A 30,278 3 91
09F2S7_04 Part B 30,278 3 91
09F2S7_04 Part C 30,278 3 93
09F2S7_09 † 30,278 5 80
09F2S7_10 † 30,278 4 95
09F2S7_12 † 30,278 3 91
09F2S7_13 † 30,278 5 92
09F2S7_14 Part A 30,278 3 86
09F2S7_14 Part B 30,278 3 90
09F2S8_06 † 30,352 4 96
09F2S8_09 † 30,352 5 86
09F2S8_11 † 30,352 2 92
09F2S8_12 † 30,352 3 81
09F2S8_13 † 30,352 4 84
09F2S9_03 † 30,189 4 86
09F2S9_06 † 30,189 4 95
09F2S9_08 † 30,189 3 91
09F2S9_09 † 30,189 4 89
09F2S9_12 † 30,189 4 96
12 09F3S10_03 † 2,016 5 97
09F3S10_05 Part A 2,016 3 87
09F3S10_05 Part B 2,016 3 91
09F3S10_06 † 2,016 3 92
09F3S10_09 Part A 2,016 3 91
09F3S10_09 Part B 2,016 3 86
09F3S10_09 Part C 2,016 3 93
09F3S10_12 † 2,016 4 95
09F3S11_05 † 2,066 4 85
09F3S11_09 † 2,066 3 90
09F3S11_10 † 2,066 3 98
09F3S11_12 † 2,066 3 85
09F3S11_13 † 2,066 4 96
09F3S12_04 † 2,014 3 95
09F3S12_05 † 2,014 5 67
09F3S12_07 † 2,014 3 88
09F3S12_10 † 2,014 4 92
09F3S12_11 † 2,014 4 92
09F3S13_04 † 2,056 5 81
09F3S13_05 † 2,056 3 89
09F3S13_06 Part A 2,056 3 98
09F3S13_06 Part B 2,056 3 95
09F3S13_07 † 2,056 3 86
09F3S13_10 † 2,056 4 98
09F3S21_01 † 2,059 3 86
09F3S21_02 Part A 2,059 4 96
09F3S21_02 Part B 2,059 4 96
09F3S21_03 Part A 2,059 3 96
09F3S21_03 Part B 2,059 3 93
09F3S21_04 Part A 2,059 3 93
09F3S21_04 Part B 2,059 3 94
09F3S21_04 Part C 2,059 3 96
09F3S21_04 Part D 2,059 3 96
09F3S21_04 Part E 2,059 3 96
09F3S21_05 † 2,059 3 90
09F3S21_06 † 2,059 3 96
09F3S22_01 † 2,059 3 86
09F3S22_02 Part A 2,059 4 77
09F3S22_02 Part B 2,059 4 88
09F3S22_03 Part A 2,059 4 91
09F3S22_03 Part B 2,059 4 95
09F3S22_03 Part C 2,059 4 97
09F3S22_04 Part A 2,059 3 88
09F3S22_04 Part B 2,059 3 89
09F3S22_04 Part C 2,059 3 91
09F3S22_05 † 2,059 3 90
09F3S22_06 Part A 2,059 3 89
09F3S22_06 Part B 2,059 3 85
09F3S22_07 † 2,059 3 93
09F3S25EXT_03 † 1,988 3 85
09F3S25EXT_04 † 1,988 3 91
09F3S25EXT_0507 Item 5 1,984 4 88
09F3S25EXT_0507 Item 7 1,984 3 85
09F3S25EXT_06 † 1,957 4 86
09F3S25EXT_10 † 1,860 3 92
09F3S25EXT_11 † 1,821 3 95
09F3S25EXT_12 Part A 1,676 4 99
09F3S25EXT_12 Part B 1,676 3 95
09F3S25EXT_13 Part A 1,575 4 97
09F3S25EXT_13 Part B 1,575 3 96
09F3S25EXT_14 † 1,511 3 96
09F3S25EXT_15 † 1,435 3 86
09F3S26_01 † 2,037 4 86
09F3S26_03 † 2,037 4 88
09F3S26_04 † 2,037 4 77
09F3S26_05 † 2,037 4 85
09F3S26_06 † 2,037 4 86
09F3S27_01 Part A 2,035 3 98
09F3S27_01 Part B 2,035 3 81
09F3S27_01 Part C 2,035 4 84
09F3S27_04 † 2,035 3 93
09F3S27_05 † 2,035 3 98
09F3S27_06 † 2,035 4 93
09F3S3_04 † 2,080 5 93
09F3S3_05 Part A 2,080 3 87
09F3S3_05 Part B 2,080 3 92
09F3S3_07 † 2,080 3 85
09F3S3_11 † 2,080 5 90
09F3S3_12 † 2,080 3 92
09F3S3_14 † 2,080 3 96
09F3S4_03 † 2,010 5 82
09F3S4_06 † 2,010 4 86
09F3S4_07 † 2,010 4 90
09F3S4_12 † 2,010 3 95
09F3S4_15 † 2,010 4 90
09F3S5_02 † 2,014 3 90
09F3S5_06 † 2,014 3 95
09F3S5_07 † 2,014 4 91
09F3S5_10 † 2,014 3 89
09F3S5_15 † 2,014 4 95
09F3S6_02 † 2,083 4 93
09F3S6_04 Part A 2,083 3 88
09F3S6_04 Part B 2,083 3 95
09F3S6_04 Part C 2,083 3 92
09F3S6_04 Part D 2,083 3 96
09F3S6_06 † 2,083 3 87
09F3S6_10 † 2,083 3 95
09F3S6_15 † 2,083 3 85
09F3S7_04 † 2,079 4 94
09F3S7_05 † 2,079 3 91
09F3S7_06 † 2,079 4 94
09F3S7_08 † 2,079 3 95
09F3S7_12 † 2,079 3 92
09F3S7_14 † 2,079 3 89
09F3S8_03 † 2,092 5 85
09F3S8_05 † 2,092 4 93
09F3S8_07 † 2,092 3 95
09F3S8_09 † 2,092 3 93
09F3S8_11 Part A 2,092 3 91
09F3S8_11 Part B 2,092 3 94
09F3S8_12 † 2,092 5 97
09F3S9_04 † 2,100 5 82
09F3S9_07 † 2,100 3 91
09F3S9_10 † 2,100 3 92
09F3S9_12 † 2,100 3 95
09F3S9_14 † 2,100 4 99
09F3S9_15 † 2,100 4 92
Last updated 16 July 2014 (GF)
Back to Top