NAEP tdw - Score Range and Percent Agreement for the Constructed-Response Items from Previous Year 2011, Rescored in 2013, Grade 12 Reading National Assessment, by Item and Block: 2013

Table of Contents | Search Technical Documentation | References

NAEP Analysis and Scaling → Initial Activities → Constructed-Response Interrater Reliability → Score Range and Percent Agreement for the Constructed-Response Items from Previous Year 2011, Rescored in 2013, Grade 12 Reading National Assessment, by Item and Block: 2013

Score range and percent agreement for the constructed-response Items from previous year 2011, rescored in 2013, grade 12 reading national assessment, by item and block: 2013
Block	Item	Range of response codes	Sample size	Percent exact agreement
NOTE: Special codes assigned to student responses including blank, off-task, and not-scorable were included in the calculation of the Percent Exact Agreement measure. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2013 Reading Assessment.
R1	R059604	1-2	900	.94
R1	R059605	1-3	800	.80
R1	R059606	1-3	900	.85
R1	R059607	1-3	800	.90
R1	R059610	1-4	800	.80
R3	R060103	1-2	800	.87
R3	R060105	1-2	900	.92
R3	R060108	1-4	800	.74
R4	R060301	1-2	900	.89
R4	R060305	1-3	900	.83
R4	R060306	1-4	900	.68
R4	R060309	1-3	800	.67
R5	R061602	1-3	800	.85
R5	R061604	1-3	800	.82
R5	R061606	1-3	800	.79
R5	R061607	1-4	1,200	.70
R5	R061608	1-2	1,100	.91
R7	R062203	1-3	800	.86
R7	R062205	1-2	900	.93
R7	R062207	1-4	800	.74
R7	R062210	1-3	1,600	.80
R8	R062303	1-3	800	.77
R8	R062304	1-3	800	.82
R8	R062308	1-4	800	.76
R8	R062311	1-3	1,000	.76
R9	R062501	1-3	900	.87
R9	R062503	1-3	800	.79
R9	R062505	1-3	1,300	.76
R9	R062508	1-4	800	.68
R10	R062705	1-3	1,000	.79
R10	R062706	1-4	1,200	.77
R10	R062708	1-2	900	.94
R10	R062710	1-3	800	.82
R11	R062902	1-3	1,000	.77
R11	R062903	1-3	800	.74
R11	R062908	1-4	800	.67
R11	R062909	1-3	1,000	.71
R12	R063101	1-3	800	.79
R12	R063105	1-4	800	.79
R12	R063109	1-3	900	.95
R12	R063801	1-3	800	.82

Score range and Cohen's Kappa or intraclass correlation for the constructed-response items from the previous year 2011, rescored in 2013, grade 12 reading national assessment, by item and block: 2013
Block	Item	Range of response codes	Sample size	Cohen’s Kappa	Intraclass correlation
† The Intraclass correlation is not reported for dichotomously scored items. NOTE: The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including blank, off-task, and not-scorable were not included in the calculation of Cohen's Kappa or intraclass correlation. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2013 Reading Assessment.
R1	R059604	1-2	800	.66	†
R1	R059605	1-3	700	.64	.76
R1	R059606	1-3	800	.69	.81
R1	R059607	1-3	700	.77	.89
R1	R059610	1-4	700	.69	.84
R3	R060103	1-2	700	.61	†
R3	R060105	1-2	800	.79	†
R3	R060108	1-4	700	.60	.77
R4	R060301	1-2	800	.61	†
R4	R060305	1-3	800	.63	.70
R4	R060306	1-4	800	.53	.61
R4	R060309	1-3	700	.44	.54
R5	R061602	1-3	700	.71	.84
R5	R061604	1-3	700	.67	.75
R5	R061606	1-3	700	.65	.83
R5	R061607	1-4	1,100	.51	.76
R5	R061608	1-2	1,000	.57	†
R7	R062203	1-3	700	.69	.66
R7	R062205	1-2	800	.87	†
R7	R062207	1-4	700	.56	.75
R7	R062210	1-3	1,500	.58	.67
R8	R062303	1-3	700	.55	.64
R8	R062304	1-3	700	.67	.76
R8	R062308	1-4	700	.62	.84
R8	R062311	1-3	900	.58	.73
R9	R062501	1-3	900	.72	.83
R9	R062503	1-3	700	.65	.79
R9	R062505	1-3	1,100	.55	.67
R9	R062508	1-4	700	.52	.72
R10	R062705	1-3	900	.65	.77
R10	R062706	1-4	1,100	.66	.86
R10	R062708	1-2	900	.85	†
R10	R062710	1-3	700	.68	.74
R11	R062902	1-3	900	.61	.72
R11	R062903	1-3	700	.56	.70
R11	R062908	1-4	700	.49	.72
R11	R062909	1-3	900	.51	.67
R12	R063101	1-3	700	.65	.79
R12	R063105	1-4	700	.66	.81
R12	R063109	1-3	900	.91	.96
R12	R063801	1-3	700	.70	.81

Last updated 13 June 2017 (GF)

Printer-friendly Version