|LAYOUT OF HANDBOOK CHAPTERS
- Uses of Data
- Key Concepts
- Survey Design
- Data Quality & Comparability
- Contact Information
- Methodology & Evaluation Reports
Since its inception, the National Center for Education Statistics (NCES) has been
committed to the policy of explaining its statistical methods to its customers and
of seeking to avoid misinterpretation of its published data. The reason for this
policy is to assure customers that proper statistical standards and techniques have been
observed, to guide them in the appropriate use of information from NCES, and to
make them aware of the known limitations of NCES data.
This first edition of the NCES Handbook of Survey Methods continues this commitment
by presenting current explanations of how each survey program in NCES obtains and
prepares the data it publishes. NCES statistics are used for many purposes, and sometimes
data well suited to one purpose may have limitations for another. This handbook
aims to provide users of NCES data with the most current information necessary to
evaluate the suitability of the statistics for their needs, with a focus on the methodologies
for survey design, data collection, and data processing. It is intended to be used as
a companion report to Programs and Plans of the National Center for Education Statistics,
which provides a summary description of the type of data collected by each program at
NCES Role and Organization
Among federal agencies collecting and issuing statistics, NCES is a general-purpose
statistical collection agency in the broad field of education. The Centerís data serve the
needs of Congress, other federal agencies, national education associations, academic
education researchers, business, and the general public. NCES is a component of the
Institute of Education Sciences (IES), formerly the Office of Educational Research and
Improvement (OERI), within the Department of Education.
Within NCES, the Statistical Standards Program, under the direction of the NCES
Chief Statistician, provides expertise in statistical standards and methodology, technology,
and customer service activities across subject matter lines. Specific survey programs
of NCES have developed around subject matter areas. As a result, the rest of NCES is
organized according to subject matter areas, with each of the survey programs falling
under one of the following four NCES divisions:
- Early Childhood, International, and Crosscutting Studies
- Elementary/Secondary and Libraries Studies
- Postsecondary Studies
Organization of the Handbook
To facilitate locating similar information for the various programs, the information in each of these chapters is
presented in a uniform format with the following standard
sections and headings:
- Overview. This section includes a description of the purpose of the survey, the
type of information collected in the survey, and the periodicity of the survey.
- Uses of Data. This section summarizes the range of issues addressed by the data
collected in the survey.
- Key Concepts. This section provides the definitions of a few important concepts
specific to the survey.
- Survey Design. This section describes the target population, the sample design,
the data collection and processing procedures, the estimation methods, and future
plans for the survey. Note that the handbook does not include a list of the data
elements collected by each survey. That information can be found in the survey questionnaires,
electronic codebooks, or data analysis systems, many available through the NCES
web site (http://nces.ed.gov). However, some general remarks about the data collected
can be made here:
- All race/ethnicity data are collected by Office of Management
and Budget (OMB) standards.
- All data on individuals can be disaggregated by sex.
- All data on individuals can also be disaggregated by Black, White, and Other,
and, for some surveys, data can be disaggregated by Hispanic and Asian/Pacific Islander.
- All elementary/secondary student-level data collections include information on
limited-English proficiency and student disability.
- School-level data collections
include information on programs and services offered.
- Data Quality and Comparability. This section describes the appropriate method to
use for estimating sampling error for sample surveys and also presents important
findings related to nonsampling error such as coverage error, unit and item nonresponse
error, and measurement error. In addition, this section provides summary descriptions
of recent design and/or questionnaire changes as well as information on comparability
of similar data collected in other studies.
- Contact Information. This section lists the name of the main contact person for
each survey along with a telephone number, e-mail address, and mailing address.
Note that at NCES, telephone numbers are assigned according to survey program; staff
members leaving one survey program for another have to change telephone numbers.
To find out the current number for a particular staff member, see the NCES Staff
Directory (http://nces.ed.gov/ncestaff/). To find out the current contacts for a
particular survey program, please check the programís web site (NCES survey web
site addresses are listed in appendix D).
- Methodology and Evaluation Reports. This section lists the primary recent methodological
reports for the survey. Use the NCES number provided to find a particular report
through the NCES Electronic Catalog (http://nces.ed.gov/ pubsearch/). Each NCES
survey Web site also contains a list of that surveyís publications.