Skip Navigation

Statistical Standards
Statistical Standards Program
 
Table of Contents
 
Introduction
1. Development of Concepts and Methods
2. Planning and Design of Surveys

 
2-1 Design of Surveys
2-2 Survey Response Rate Parameters
2-3 Developing RFPs for Surveys
2-4 Pretesting Survey Systems
2-5 Maintaining Data Series Over Time
2-6 Educational Testing
 

3. Collection of Data
4. Processing and Editing of Data
5. Analysis of Data / Production of Estimates or Projections
6. Establishment of Review Procedures
7. Dissemination of Data
 
Glossary
Appendix A
Appendix B
Appendix C
Appendix D
 
Publication information

For help viewing PDF files, please click here
PLANNING AND DESIGN OF SURVEYS

SUBJECT: SURVEY RESPONSE RATE PARAMETERS

NCES STANDARD: 2-2

PURPOSE: To specify design parameters for survey response rates. High survey response rates help to ensure that survey results are representative of the target population. Surveys conducted by or for NCES must be designed and executed to meet the highest practical rates of response. To ensure that nonresponse bias analyses are conducted when response rates suggest the potential for bias to occur.

KEY TERMS: assessment, cross-sectional, key variables, longitudinal, nonresponse bias, response rates, stage of data collection, substitution, target population, and universe.


STANDARD 2-2-1:
Universe data collections must be designed to meet a target unit response rate of at least 95 percent.

    GUIDELINE 2-2-1A: A unit level nonresponse bias analysis is recommended in the case where the universe survey unit response rate is less than 90 percent. (See Standard 4-4 for a discussion of nonresponse bias analysis.)


STANDARD 2-2-2:
Sample survey unit response rates must be calculated without substitutions (see Standard 1-3). NCES sample survey data collections must be designed to meet unit level response rate parameters that are at least consistent with historical response rates from surveys conducted with best practices.

    GUIDELINE 2-2-2A: The following parameters summarize current NCES historical experiences:

    1. For longitudinal sample surveys, the target school level unit response rate should be at least 70 percent. In the base year and each follow-up, the target unit response rates at each additional stage should be at least 90 percent.
       
    2. For cross-sectional samples, the target unit response rate should be at least 85 percent at each stage of data collection.
       
    3. For random-digit dial sample surveys, the target unit response rate should be at least 70 percent for the screener and at least 90 percent for each survey component.
       
    4. For household sample surveys, the target response rates should be at least 90 percent for the screener, and at least 85 percent for the respondents.
       
    5. For assessments, the target response rate should be at least 80 percent for schools and at least 85 percent for students.

Stage-Specific Design Response Rates by Type of Survey

Type of Survey Stage-Specific
Design Response Rates
Screener School All Other

Universe

Cross-sectional

Longitudinal

Assessment

Random-Digit Dial>

Household

¾

¾

¾

¾

70

90

¾

85

70

80

¾

¾

95

85

90

85

90

85



STANDARD 2-2-3: NCES sample survey data collections must be designed to meet a target item response rate of at least 90 percent for each key item.


STANDARD 2-2-4: A nonresponse bias analysis is required at any stage of a data collection with a unit response rate less than 85 percent. If the item response rate is below 85 percent for any items used in a report, a nonresponse bias analysis is also required for each of those items (this does not include individual test items). The extent of the analysis must reflect the magnitude of the nonresponse (see Standard 4-4).

In longitudinal sample surveys, item nonresponse bias analyses need only be done once for any individual item, unless there is a substantial deterioration in the item response rate.


STANDARD 2-2-5: In cases where prior experience suggests the potential for an overall unit response rate of less than 50 percent, the decision to proceed with data collection must be made in consultation with the Associate Commissioner, Chief Statistician, and Commissioner.