Skip to main content

Table of Contents | Search Technical Documentation | References

NAEP Analysis and ScalingEstimation of NAEP Score ScalesTreatment of Items in NAEP to Avoid Violations of AssumptionsResults of NAEP Differential Item Functioning (DIF) Analyses → Number of Items by Severity of Differential Item Functioning (DIF), Technology and Engineering Literacy (TEL) National Assessment: 2018

NAEP Technical DocumentationNumber of Items by Severity of Differential Item Functioning (DIF) in the Technology and Engineering Literacy (TEL) National Assessment

For dichotomously scored items, NAEP categorizes each item into one of three categories: "A" (items exhibiting no DIF), "B" (items exhibiting a weak indication of DIF), or "C" (items exhibiting a strong indication of DIF). A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups. A minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. For polytomously scored items, NAEP categorizes items into "AA," "BB," or "CC" categories and the plus or minus sign has the same interpretation as for dichotomously scored items. After reviewing "C" and "CC" items, subject area specialists decided that no items were biased, so none were deleted from the scale for this reason.

Number of dichotomously scored items, technology and engineering literacy (TEL) national assessment, by differential item functioning (DIF) group, grade, and DIF category: 2018
GradeDIF categoryFemale/MaleBlack/WhiteHispanic/White
8C-121
B-464
A918995
B+552
C+100
NOTE: In 2018, grades 4 and 12 were not assessed. The table includes all items in the assessment (the prescaling decisions).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Technology and Engineering Literacy (TEL) Assessment.

Number of polytomously scored items, technology and engineering literacy (TEL) national assessment, by differential item functioning (DIF) group, grade, and DIF category: 2018
GradeDIF categoryFemale/MaleBlack/WhiteHispanic/White
8CC-000
BB-021
AA757074
BB+142
CC+110
NOTE: In 2018, grades 4 and 12 were not assessed. The table includes all items in the assessment (the prescaling decisions).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Technology and Engineering Literacy (TEL) Assessment.

Items identified as "C" items in at least one comparison, technology and engineering literacy (TEL) national assessment, by grade, assembly unit, and content area scale: 2018
GradeAssembly unitItemScaleComparisonGroup favored
8T5D004601Technology and societyHispanic/WhiteWhite
T10D019102Design and systemsFemale/MaleFemale
T15D014302Design and systemsFemale/MaleMale
T20D018801Technology and societyBlack/WhiteWhite
T20D018803Technology and societyBlack/WhiteWhite
NOTE: In 2018, grades 4 and 12 were not assessed.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Technology and Engineering Literacy (TEL) Assessment.

Items identified as "CC" items in at least one comparison, technology and engineering literacy (TEL) national assessment, by grade, assembly unit, and content area scale: 2018
GradeAssembly unitItemScaleComparisonGroup favored
8T6D005001Technology and societyFemale/MaleFemale
T17D0117CLDesign and systemsBlack/WhiteBlack
NOTE: In 2018, grades 4 and 12 were not assessed.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Technology and Engineering Literacy (TEL) Assessment.


Last updated 26 January 2023 (ML)