Skip Navigation
small NCES header image

Table of Contents  |  Search Technical Documentation  |  References

Internal Quality Control Checks

The sampling and weighting staff perform the following quality control checks during the various weighting stages for NAEP:

  • reviewing the computer code used to calculate and assign weights in order to check implementation of weighting specifications;
  • checking input file and variable names, and output files and variable names;
  • checking the SAS logs for missing values and other warnings when SAS programs are used for implementation;
  • reviewing a sample of records to verify weight calculations and/or assignments;
  • comparing the weighted sample counts and/or totals with the corresponding frame counts and other control totals, or estimates from the previous weighting stage, whenever available;
  • calculating and checking descriptive statistics of the weights, including
    • a listing of extreme weights,
    • the sum of the weights,
    • the number of cases with missing weights,
    • percentiles of the weight distribution, and
    • average weights within selected and relevant student groups; and
  • checking any other statistics that could be used to confirm expected patterns.

NAEP sampling and weighting staff have developed SAS macros for use in weighting for complex sample surveys. These macros perform such tasks as cell-weighting adjustments for nonresponse, poststratification (not used in state assessment), raking, creation of replicates for variance estimation, and weighting adjustments (i.e., nonresponse adjustment, poststratification, and raking) of the replicate weights.


Last updated 22 May 2008 (DB)

Printer-friendly Version


Would you like to help us improve our products and website by taking a short survey?

YES, I would like to take the survey

or

No Thanks

The survey consists of a few short questions and takes less than one minute to complete.
National Center for Education Statistics - http://nces.ed.gov
U.S. Department of Education