Skip to main content
Skip Navigation

NAEP TECHNICAL DOCUMENTATIONQuality Control

The materials distribution processing scoring (MDPS) contractor implements quality control procedures to ensure the processed and scoring data sent to the sampling design contractor (SDC) and design, analysis, and reporting (DAR) contractor are correct. This includes verifying:

  • the output files are created, and the data are displaying correctly
  • the student files match the approved record layouts by SDC and DAR. 
  • the "teacher to student match" file contains a record for each record in the input student file that has a matching grade, teacher, and school ID combination present in the teacher questionnaire file.
  • the "no match" file contains a record for each record in the input student file that has a valid teacher number on the record, but does not have a matching grade, teacher, school number combination present in the teacher file.
  • the frequency distribution (FD) reports are created for each grade.
  • the output files are created on the SFTP site and the data are correct.

The MDPS contractor provides a detailed frequency distribution (FD) reports to the DAR contractor with the final data file. The FD file indicates: 

  • the total number of responses for each item for paper-based assessment (PBA) and digitally based assessment (DBA), 
  • the number of students who answered each possible response for the multiple-choice items,
  • the number of students who received each score point for the open-ended constructed response items.
  • indicates the total number of responses for each item for school and teacher questionnaires, and
  • indicates the number of school personnel and teachers who answered each possible response for each item in the school and teacher questionnaires.

The FD file does allow the DAR contractor to identify possible issues. If the responses or score points in the FDs do not match the expected results (e.g., an unexpected large or small number of students answered a certain response or received a certain score point), data users would know that further investigation is necessary. The FD files does not include data for short-answer machine-scored items since the DAR contractor scores these responses. 

The MDPS contractor spot checks DBA short-answer responses in the first couple of weeks as the data are processed prior to sending it to DAR for scoring. The DAR contractor compares the frequency distribution file from their database to verify the data received matches. If there is a discrepancy, the situation is researched and resolved. 


Last updated 08 June 2023 (SK)