Table of Contents | Search Technical Documentation | References

NAEP Analysis and Scaling → Estimation of NAEP Score Scales → Treatment of Items in NAEP to Avoid Violations of Assumptions → Results of NAEP Differential Item Functioning (DIF) Analyses → Number of Items by Severity of Differential Item Functioning (DIF), Civics National Assessment: 2018

NAEP Technical DocumentationNumber of Items by Severity of Differential Item Functioning (DIF) in the Civics National Assessment

For dichotomously scored items, NAEP categorizes each item into one of three categories: "A" (items exhibiting no DIF), "B" (items exhibiting a weak indication of DIF), or "C" (items exhibiting a strong indication of DIF). A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups. A minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. For polytomously scored items, NAEP categorizes items into "AA," "BB," or "CC" categories and the plus or minus sign has the same interpretation as for dichotomously scored items. After reviewing "C" and "CC" items, subject area specialists decided that no items were biased, so none were deleted from the scale for this reason.

Number of dichotomously scored items, civics DBA national assessment, by differential item functioning (DIF) group, grade, and DIF category: 2018

Grade	DIF category	Female/Male	Black/White	Hispanic/White
8	C-	0	0	0
	B-	4	0	0
	A	109	0	111
	B+	5	0	7
	C+	0	0	0
NOTE: DBA = Digitally based assessment. In 2018, grades 4 and 12 were not assessed. The table includes all items in the assessment (the prescaling decisions). SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Number of dichotomously scored items, civics PBA national assessment, by differential item functioning (DIF) group, grade, and DIF category: 2018

Grade	DIF category	Female/Male	Black/White	Hispanic/White
8	C-	1	0	0
	B-	6	0	4
	A	110	0	108
	B+	3	0	8
	C+	0	0	0
NOTE: PBA = Paper-based assessment. In 2018, grades 4 and 12 were not assessed. The table includes all items in the assessment (the prescaling decisions). SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Number of polytomously scored items, civics DBA national assessment, by differential item functioning (DIF) group, grade, and DIF category: 2018

Grade	DIF category	Female/Male	Black/White	Hispanic/White
8	CC-	0	0	0
	BB-	3	0	1
	AA	39	0	47
	BB+	6	0	3
	CC+	3	0	0
NOTE: DBA = Digitally based assessment. In 2018, grades 4 and 12 were not assessed. The table includes all items in the assessment (the prescaling decisions). SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Number of polytomously scored items, civics PBA national assessment, by differential item functioning (DIF) group, grade, and DIF category: 2018

Grade	DIF category	Female/Male	Black/White	Hispanic/White
8	CC-	0	0	0
	BB-	1	0	1
	AA	26	0	31
	BB+	4	0	0
	CC+	1	0	0
NOTE: PBA = Paper-based assessment. In 2018, grades 4 and 12 were not assessed. The table includes all items in the assessment (the prescaling decisions). SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Items identified as "CC" items in at least one comparison, civics DBA national assessment, by grade and block: 2018

Grade	Block	Item	Comparison	Group favored
8	C4	P040903	Female/Male	Female
	C4	P040910	Female/Male	Female
	C6	P070801	Female/Male	Female
NOTE: DBA = Digitally based assessment. In 2018, grades 4 and 12 were not assessed. No "C" items were identified. The block naming conventions used in this table are described in the document 2018 Block Naming Conventions in Data Products and TDW . SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Items identified as "C" items in at least one comparison, civics PBA national assessment, by grade and block: 2018

Grade	Block	Item	Comparison	Group favored
8	C10	P042168	Female/Male	Male
NOTE: PBA = Paper-based assessment. In 2018, grades 4 and 12 were not assessed. The block naming conventions used in this table are described in the document 2018 Block Naming Conventions in Data Products and TDW . SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Items identified as "CC" items in at least one comparison, civics PBA national assessment, by grade and block: 2018

Grade	Block	Item	Comparison	Group favored
8	C5	P040903	Female/Male	Female
NOTE: PBA = Paper-based assessment. In 2018, grades 4 and 12 were not assessed. The block naming conventions used in this table are described in the document 2018 Block Naming Conventions in Data Products and TDW . SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.