Item-by-Item Interrater Agreement, Mathematics Assessment, by Grade: 2019

Table of Contents | Search Technical Documentation | References

NAEP Scoring → Scoring Monitoring → Within-Year Interrater Agreement → Mathematics Interrater Agreement → Item-by-Item Interrater Agreement, Mathematics Assessment, by Grade: 2019

NAEP Technical DocumentationItem-by-Item Interrater Agreement, Mathematics Assessment, by Grade: 2019
Item-by-item interrater agreement, mathematics assessment, by grade: 2019
Grade	NAEP ID	Part	Number of responses scored	Score points	Agreement
4	1919MA1N01_03	†	23,312	2	100
	1919MA1N01_06	†	26,174	3	97
	1919MA1N01_08	†	23,297	2	100
	1919MA1N01_15	Part A	23,729	2	100
	1919MA1N01_15	Part B	23,729	3	96
	1919MA1N01_17	†	23,260	3	96
	1919MA1N02_03	†	23,876	2	100
	1919MA1N02_06	†	23,758	2	100
	1919MA1N02_16	†	25,253	3	99
	1919MA1N02_17	†	20,540	3	98
	1917MA1T03_05	†	26,425	2	100
	1917MA1T03_07	Part A	25,954	2	100
	1917MA1T03_07	Part B	25,954	2	100
	1917MA1T03_13	Part A	18,798	2	100
	1917MA1T03_13	Part B	18,798	3	98
	1917MA1T03_15	Part A	18,599	2	99
	1917MA1T03_15	Part B	18,599	3	99
	1917MA1T04_07	†	23,605	3	98
	1917MA1T04_10	†	24,338	3	98
	1917MA1T04_13	†	23,688	2	100
	1917MA1T05_03	†	24,158	3	99
	1917MA1T05_10	†	20,575	3	98
	1917MA1T05_12	†	23,948	2	97
	1917MA1T05_14	†	24,440	2	100
	1917MA1T06_04	†	24,293	3	99
	1917MA1T06_09	†	24,680	3	94
	1917MA1T06_11	†	26,707	3	93
	1917MA1T06_14	†	26,233	3	99
	1917MA1T07_04	†	21,825	3	99
	1917MA1T07_14	Part A	25,455	2	98
	1917MA1T07_14	Part B	25,455	2	99
	1917MA1T07_14	Part C	25,455	2	100
	1917MA1T07_16	†	24,971	3	99
	1917MA1T08_02	†	27,454	2	100
	1917MA1T08_04	†	28,064	2	100
	1917MA1T08_08	†	27,637	2	100
	1917MA1T08_10	†	25,227	3	99
	1917MA1T08_11	†	20,010	3	100
	1917MA1T08_14	Part A	16,978	3	100
	1917MA1T08_14	Part B	16,978	3	100
	1919MA1N09_10	†	28,233	2	100
	1919MA1N09_12	†	26,486	3	99
	1919MA1N09_14	†	25,621	2	100
	1919MA1N09_15	†	20,847	3	100
	1919MA1N09_17	†	18,370	2	100
	1917MA1T10_03	†	27,243	3	99
	1917MA1T10_07	†	29,142	2	99
	1917MA1T10_13	†	27,634	2	100
	1919MA1N11_03	†	24,520	2	99
	1919MA1N11_06	†	24,146	3	99
	1919MA1N11_12	Part A	25,284	2	100
	1919MA1N11_12	Part B	25,284	2	100
	1919MA1N11_15	†	23,636	3	98
	1919MA1N12_03	†	24,515	3	97
	1919MA1N12_09	†	25,923	2	100
	1919MA1N12_14	†	22,406	3	96
	1919MA1N12_16	†	24,960	3	98
	1919MA1N12_17	†	18,764	2	100
	1919MA1N13_03	†	29,456	2	99
	1919MA1N13_09	†	27,447	2	100
	1919MA1N13_12	†	24,567	2	100
	1919MA1N13_16	Part A	21,885	2	100
	1919MA1N13_16	Part B	21,885	3	97
	1919MA1N14_03	†	27,942	2	99
1919MA1N14_05	†	26,851	3	100
1919MA1N14_07	†	26,294	2	100
1919MA1N14_12	Part A	25,037	2	99
1919MA1N14_12	Part B	25,037	3	97
1917MA1T03_05BL	†	499	2	99
1917MA1T03_07BL	Part A	485	2	99
1917MA1T03_07BL	Part B	485	2	100
1917MA1T03_13BL	Part A	452	2	100
1917MA1T03_13BL	Part B	452	3	100
1917MA1T03_15BL	Part A	434	2	100
1917MA1T03_15BL	Part B	434	3	100
1917MA1T04_07BL	†	482	3	99
1917MA1T04_10BL	†	491	3	98
1917MA1T04_13BL	†	473	2	100
1919MA1N09_10BL	†	465	2	100
1919MA1N09_12BL	†	457	3	100
1919MA1N09_14BL	†	448	2	100
1919MA1N09_15BL	†	418	3	100
1919MA1N09_17BL	†	399	2	100
1919MA1T10_03BL	†	481	3	99
1919MA1T10_07BL	†	477	2	100
1919MA1T10_13BL	†	465	2	100
1919MA1M01_07PR	†	1,186	2	100
1919MA1M01_16PR	†	1,177	2	99
1919MA1M02_12PR	†	150	2	100
1919MA1M02_15PR	†	148	2	100
1919MA1M02_17PR	†	145	2	100
1919MA1M03_17PR	†	142	3	100
1919MA1M03_19PR	†	136	2	100
1919MA1M04_11PR	Part A	108	2	100
1919MA1M04_11PR	Part B	108	2	100
1919MA1M04_11PR	Part C	108	2	100
1919MA1M04_14PR	†	123	3	100
1919MA1M05_11PR	†	136	3	97
1919MA1M05_18PR	†	138	3	100
1919MA1M06_04PR	†	1,156	2	100
1919MA1M06_08PR	†	1,096	3	99
1919MA1M06_14PR	†	1,112	3	99
1919MA1M06_17PR	†	1,085	2	100
1919MA1M07_04PR	†	1,170	2	99
1919MA1M07_07PR	†	1,145	3	97
1919MA1M07_11PR	†	1,160	2	100
1919MA1M07_13PR	†	1,110	3	100
1919MA1M07_15PR	†	1,150	2	100
1919MA1M08_02PR	†	1,113	2	98
1919MA1M08_04PR	†	1,108	2	100
1919MA1M08_06PR	†	1,110	3	99
1919MA1M08_08PR	†	1,121	2	100
1919MA1M08_14PR	†	1,076	2	100
1919MA1M09_03PR	†	1,157	2	100
1919MA1M09_08PR	†	1,082	3	98
1919MA1M09_10PR	†	1,099	3	100
1919MA1M09_13PR	Part A	997	2	100
1919MA1M09_13PR	Part B	997	2	100
1919MA1M09_15PR	†	883	2	100
1919MA1M10_03PR	†	193	3	96
1919MA1M10_05PR	†	173	2	98
1919MA1M10_06PR	†	192	3	100
1919MA1M10_09PR	†	187	2	100
1919MA1M10_10PR	†	167	3	100
1919MA1M10_12PR	Part A	163	2	100
1919MA1M10_12PR	Part B	163	3	100
1919MA1M10_14PR	†	145	2	100
1919MA1M11_01PR	†	150	2	100
1919MA1M11_10PR	†	117	2	100
1919MA1M11_12PR	†	137	3	100
1919MA1M11_14PR	Part A	128	2	100
1919MA1M11_14PR	Part B	128	2	100
1919MA1M11_16PR	†	137	3	100
1919MA1M12_07PR	†	128	3	97
1919MA1M12_10PR	†	114	3	100
1919MA1M12_15PR	Part A	145	2	100
1919MA1M12_15PR	Part B	145	3	100
1919MA1M12_17PR	†	118	3	100
1919MA1M13_09PR	Part A	75	2	100
1919MA1M13_09PR	Part B	75	3	100
1919MA1M13_11PR	†	68	3	100
1919MA1M13_13PR	†	55	3	100
1919MA1M13_15PR	†	69	2	100
8	1919MA2N01_03	†	25,711	2	100
	1919MA2N01_06	†	23,501	2	100
	1919MA2N01_08	†	25,570	2	100
	1919MA2N01_12	†	21,027	2	100
	1919MA2N01_14	Part A	24,789	2	98
	1919MA2N01_14	Part B	24,789	2	97
	1919MA2N01_14	Part C	24,789	2	98
	1917MA2T02_04	Part A	26,471	2	100
	1917MA2T02_04	Part B	26,471	2	100
	1917MA2T02_04	Part C	26,471	2	100
	1917MA2T02_07	†	23,983	3	99
	1917MA2T02_12	†	22,544	3	94
	1917MA2T02_15	†	20,267	3	100
	1919MA2N03_02	†	23,536	2	100
	1919MA2N03_06	†	23,289	2	100
	1919MA2N03_11	†	23,221	3	91
	1919MA2N03_15	Part A	22,480	3	97
	1919MA2N03_15	Part B	22,480	3	98
	1917MA2T04_02	Part A	23,930	2	100
	1917MA2T04_02	Part B	23,930	2	99
	1917MA2T04_06	†	24,018	3	99
	1917MA2T04_12	†	19,976	2	100
	1917MA2T04_15	†	21,788	3	100
	1917MA2T05_08	†	24,149	3	99
	1917MA2T05_10	†	23,986	3	89
	1917MA2T05_15	†	23,855	3	100
	1917MA2T06_01	†	26,849	3	100
	1917MA2T06_09	†	24,402	3	99
	1917MA2T06_15	†	20,965	3	96
	1917MA2T06_16	†	18,602	3	98
	1917MA2T07_07	†	24,278	2	100
	1917MA2T07_11	†	24,408	2	100
	1917MA2T07_17	†	24,034	2	100
	1917MA2T08_02	†	28,903	3	100
	1917MA2T08_06	†	25,713	2	100
	1917MA2T08_10	†	23,170	3	100
	1917MA2T08_13	Part A	24,087	2	99
	1917MA2T08_13	Part B	24,087	2	100
	1917MA2T08_13	Part C	24,087	2	99
	1919MA2N09_04	†	28,889	3	99
	1919MA2N09_14	†	24,835	3	99
	1919MA2N09_15	†	22,799	2	100
	1919MA2N09_17	†	21,833	3	100
	1917MA2T10_07	†	28,847	2	100
	1917MA2T10_12	†	26,227	3	99
	1917MA2T10_15	†	25,038	3	100
	1917MA2T10_19	†	26,962	3	99
	1919MA2N11_03	†	24,748	2	100
	1919MA2N11_08	†	24,611	2	99
	1919MA2N11_10	†	24,268	2	100
	1919MA2N11_13	†	23,021	4	97
	1919MA2N12_04	†	24,324	2	99
	1919MA2N12_08	†	25,810	3	99
	1919MA2N12_11	†	26,617	3	99
	1919MA2N12_15	Part A	21,662	2	99
	1919MA2N12_15	Part B	21,662	4	96
	1919MA2N13_03	Part A	29,872	3	99
	1919MA2N13_03	Part B	29,872	2	99
	1919MA2N13_15	†	21,897	3	94
	1919MA2N13_17	†	18,821	3	100
	1919MA2N14_04	†	28,919	2	100
	1919MA2N14_06	†	28,727	2	100
	1919MA2N14_14	Part A	23,579	3	98
	1919MA2N14_14	Part B	23,579	2	100
1919MA2N03_02BL	†	364	2	100
1919MA2N03_06BL	†	360	2	100
1919MA2N03_11BL	†	351	3	99
1919MA2N03_15BL	Part A	345	3	100
1919MA2N03_15BL	Part B	345	3	98
1917MA2T04_02BL	Part A	351	2	100
1917MA2T04_02BL	Part B	351	2	100
1917MA2T04_06BL	†	346	3	99
1917MA2T04_12BL	†	352	2	100
1917MA2T04_15BL	†	336	3	99
1919MA2N09_04BL	†	374	3	100
1919MA2N09_14BL	†	357	3	99
1919MA2N09_15BL	†	347	2	100
1919MA2N09_17BL	†	328	3	100
1919MA2T10_07BL	†	368	2	99
1919MA2T10_12BL	†	370	3	99
1919MA2T10_15BL	†	357	3	100
1919MA2T10_19BL	†	345	3	98
1919MA2M01_06PR	Part A	1,244	3	98
1919MA2M01_06PR	Part B	1,244	2	99
1919MA2M01_11PR	†	1,276	3	99
1919MA2M02_04PR	†	197	3	100
1919MA2M02_16PR	Part A	141	2	100
1919MA2M02_16PR	Part B	141	2	100
1919MA2M02_16PR	Part C	141	2	100
1919MA2M03_16PR	Part A	115	2	100
1919MA2M03_16PR	Part B	115	2	100
1919MA2M03_16PR	Part C	115	2	100
1919MA2M03_19PR	†	104	3	100
1919MA2M04_13PR	Part A	148	2	100
1919MA2M04_13PR	Part B	148	2	100
1919MA2M04_13PR	Part C	148	2	100
1919MA2M04_15PR	†	147	3	100
1919MA2M05_06PR	†	141	3	100
1919MA2M05_14PR	†	114	3	100
1919MA2M06_03PR	†	974	2	99
1919MA2M06_05PR	†	1,100	2	100
1919MA2M06_13PR	†	1,060	2	100
1919MA2M06_15PR	†	1,038	2	100
1919MA2M07_06PR	†	1,089	2	100
1919MA2M07_09PR	†	1,071	2	100
1919MA2M07_12PR	†	1,060	3	100
1919MA2M07_14PR	†	1,094	2	100
1919MA2M07_16PR	†	1,090	2	100
1919MA2M08_03PR	†	1,239	2	100
1919MA2M08_07PR	†	1,211	2	100
1919MA2M08_11PR	†	1,207	2	100
1919MA2M08_14PR	†	1,228	3	100
1919MA2M09_01PR	†	1,091	2	100
1919MA2M09_04PR	†	1,067	2	100
1919MA2M09_07PR	†	928	3	100
1919MA2M09_10PR	†	932	3	100
1919MA2M09_12PR	†	963	3	99
1919MA2M09_15PR	†	916	3	100
1919MA2M10_05PR	†	272	3	100
1919MA2M10_08PR	†	278	3	100
1919MA2M10_09PR	†	233	2	100
1919MA2M10_16PR	†	252	3	100
1919MA2M10_17PR	†	249	3	100
1919MA2M11_04PR	†	138	2	100
1919MA2M11_09PR	†	125	3	100
1919MA2M11_11PR	†	120	3	97
1919MA2M11_13PR	†	131	3	100
1919MA2M11_16PR	†	104	4	96
1919MA2M12_03PR	Part A	130	2	100
1919MA2M12_03PR	Part B	130	2	94
1919MA2M12_07PR	†	133	2	100
1919MA2M12_14PR	†	122	3	100
1919MA2M12_17PR	Part A	121	3	100
1919MA2M12_17PR	Part B	121	3	100
1919MA2M13_02PR	†	65	3	100
1919MA2M13_08PR	†	64	3	94
1919MA2M13_10PR	†	68	2	100
1919MA2M13_13PR	Part A	63	3	100
1919MA2M13_13PR	Part B	63	2	100
12	1919MA3N01_08	†	2,245	2	100
	1919MA3N01_09	†	2,174	3	99
	1919MA3N01_12	†	2,098	3	99
	1919MA3N01_14	†	1,649	5	98
	1919MA3N02_03	†	2,268	3	98
	1919MA3N02_13	Part A	2,222	2	99
	1919MA3N02_13	Part B	2,222	3	100
	1919MA3N02_15	†	1,990	2	100
	1919MA3N03_04	†	2,409	3	91
	1919MA3N03_07	†	2,289	3	99
	1919MA3N03_14	†	2,327	2	100
	1919MA3N03_17	†	2,291	2	100
	1919MA3N04_08	†	2,332	3	95
	1919MA3N04_10	†	2,239	5	99
	1919MA3N04_12	†	2,248	2	100
	1919MA3N04_16	†	2,155	3	99
	1919MA3N05_03	†	2,275	2	100
	1919MA3N05_04	†	2,274	3	99
	1919MA3N05_05	†	2,240	2	100
	1919MA3N05_11	†	2,061	2	100
	1919MA3N05_17	Part A	2,288	3	99
	1919MA3N05_17	Part B	2,288	3	98
	1919MA3N06_03	†	2,274	2	100
	1919MA3N06_09	†	2,088	2	100
	1919MA3N06_11	†	1,952	3	100
	1919MA3N06_16	†	2,241	3	100
	1919MA3N07_10	†	2,386	2	100
	1919MA3N07_13	Part A	2,204	2	99
	1919MA3N07_13	Part B	2,204	3	98
	1919MA3N08_05	†	2,305	2	100
	1919MA3N08_07	†	2,334	2	100
	1919MA3N08_10	†	2,207	3	97
	1919MA3N08_14	†	2,046	4	98
	1919MA3N09_03	†	2,489	2	100
	1919MA3N09_08	Part A	2,445	2	100
	1919MA3N09_08	Part B	2,445	2	100
	1919MA3N09_16	Part A	1,979	3	99
	1919MA3N09_16	Part B	1,979	2	97
	1919MA3N09_16	Part C	1,979	2	100
	1919MA3N09_17	†	2,179	3	100
	1919MA3N10_05	†	2,428	2	100
	1919MA3N10_08	†	2,450	3	100
	1919MA3N10_13	Part A	2,347	2	99
	1919MA3N10_13	Part B	2,347	3	97
	1919MA3N10_15	†	2,285	3	93
	1919MA3N10_17	†	2,267	3	98
	1919MA3N11_03	†	2,384	2	100
	1919MA3N11_06	†	2,358	2	100
	1919MA3N11_10	†	2,364	3	92
	1919MA3N11_15	†	2,271	3	99
	1919MA3N11_19	†	2,173	3	98
† Not applicable. NOTE: Separate statistics are provided for each part of multi-part items. NAEP ID = identifier for each NAEP item in the scoring system; Score points = number of score levels for an item; Agreement = percent exact agreement between first and second scores. Items with "BL" at the end of the identifier were in bilingual booklets in which the student has the option of answering in either English or Spanish. Items with "PR" at the end of the identifier were in Spanish language booklets assessed in Puerto Rico. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2019 Mathematics Assessment.

Last updated 06 June 2023 (SK)

Printer-friendly Version

NAEP Technical DocumentationItem-by-Item Interrater Agreement, Mathematics Assessment, by Grade: 2019