|SURVEY OF A SAMPLE OF ELEMENTARY/ SECONDARY STUDENTS|
The National Assessment of Educational Progress (NAEP) is mandated by Congress to assess the educational achievement of U.S. students and monitor changes in those achievements. As the oldest nationally representative and continuing assessment of what America’s students know and can do in subject areas, NAEP serves as the “Nation’s Report Card.” Main NAEP includes state and national assessments of students in grades 4, 8, and 12 in various subject areas and with varying periodicity. The Trial Urban District Assessment, or TUDA, assesses students in large urban districts at grades 4 and 8 in reading, mathematics, science, and writing. The Long–Term Trend Assessment is administered to students at ages 9, 13, and 17 in reading and mathematics and only at the national level. Results go back as far as 1971.
In 1988, Congress established the National Assessment Governing Board (referred to as the Governing Board or NAGB) to provide policy guidance for the execution of NAEP. The 26-member Governing Board is an independent, bipartisan group whose members include governors, state legislators, local and state school officials, educators, business representatives, and members of the general public. Its responsibilities include: select subject areas to be assessed; set appropriate student achievement levels; develop assessment objectives and test specifications; design the assessment methodology; and produce standards and procedures for interstate, regional, and national comparisons. NAEP is administered by the National Center for Education Statistics (NCES).
To (1) monitor continuously the knowledge, skills, and performance of the nation’s children; and (2) provide objective data about student performance at the national and regional levels, the state level (since 1990), and for large urban school districts (since 2002).
NAEP comprises two separate assessments: main and long-term trend. Results for three geographic levels are reported in the main assessment: national, state and urban school district. The long-term trend assessment is conducted at the national level only. Two additional surveys, the High School Transcript Study (HSTS) and the National Indian Education Study (NIES), are conducted in conjunction with NAEP.
Since 1996, the main national and state assessments have provided accommodations for students with special needs, while the TUDA assessments have offered them since their inception. Long-term trend NAEP began offering accommodations in 2004.
National-level assessment. The main national NAEP and the long-term trend NAEP are both designed to report information for the nation and specific geographic regions of the country (Northeast, Southeast, Central, and West). However, these two assessments use separate samples of students from public and nonpublic schools: grade samples for the main national NAEP (grades 4, 8, and 12), and age samples for the long-term trend NAEP (ages 9, 13, and 17).
The test instruments for the main and long-term trend assessments are based on different frameworks; the student and teacher background questionnaires vary; and the results for the two assessments are reported separately. (See “Elementary and Secondary School Students Survey” below for the subject areas assessed.)
The assessments in the main national NAEP follow the frameworks developed by NAGB and use the latest advances in assessment methodology. The test instruments are flexible so they can be adapted to changes in curricular and educational approaches. Assessment instruments for the main NAEP reading and mathematics assessments have produced valid trend results from 1990 through 2015, except for changes introduced in 2009 in the mathematics assessment for grade 12 and the science assessment across grades. In 2005 and 2009 the Governing Board introduced changes in the NAEP mathematics framework for grade 12 in both the assessment content and administration procedures resulting in a break in trend. In 2009, a new framework was developed for science, also resulting in a break in trend. Since 2009, the mathematics, reading, science, and writing assessments were developed using the same framework, allowing the results to be compared from 2009 forward.
To reliably measure change over longer periods of time, the long-term trend NAEP must be used. Long-term trend NAEP allows measurement of trends since 1971 in reading and 1973 in mathematics.
State-level assessments. The main state NAEP was implemented in 1990 on a trial basis. Participation of the states was voluntary until 2003. The reauthorization of the Elementary and Secondary Education Act requires states that receive Title I funding to participate in state NAEP assessments in reading and mathematics at grades 4 and 8 every two years. State participation in other state NAEP subjects (i.e., science and writing) remains voluntary. Participation is voluntary for students for all NAEP assessments. Separate representative samples of students are selected for each jurisdiction to provide that jurisdiction with reliable state-level data concerning the achievement of its students. The state assessment included nonpublic schools in 1994, 1996, and 1998. This practice ended because of low participation rates.
The Trial Urban District Assessment. The Trial Urban District Assessment (TUDA) began assessing performance in selected large urban districts in 2002 in reading and writing; it continued in 2003 with reading and mathematics; in 2005 with reading, mathematics, and science; in 2007 with reading, mathematics and writing; in 2009 with reading, mathematics and science; in 2011 and 2013 with reading and mathematics; and in 2015 with reading, mathematics, and science. The program retains its trial status. The first TUDA occurred in 2002 for five urban districts. Nine urban districts participated in 2003, 10 districts participated in 2005 and 2007, 18 participated in 2009 and 21 participated in 2011, 2013, and 2015. The results for these districts are for public school students only. Beginning in 2009, the TUDA results include only those charter schools that the district is accountable for. Results for these districts are also compared with results for public school students in large central cities and the nation.
Results for District of Columbia public school students, normally included with NAEP’s state assessment results, are also included in TUDA reports on mathematics for 2003, 2005, 2007, 2009, 2011, 2013, and 2015, as well as for reading for those same years plus 2002. Due to an insufficient sample size, the District of Columbia did not participate in the science assessments in 2005 and 2009, nor did it participate in the writing assessment in 2007 for the same reason.
Subjects assessed in NAEP.The primary data collected by NAEP relate to student performance and educational experience. Major assessment areas for main NAEP include reading, writing, mathematics, and science, which are assessed at the national, state, and district levels. At grades 4 and 8, mathematics and reading are assessed every two years; at grade 12, they are assessed every four years. Science and writing are assessed every four years in grades 4 and 8. Other subject areas (e.g., civics, U.S. history, geography, economics, technology and engineering literacy, and the arts) are assessed only at the national level, occur less frequently and, usually do not include all three grades.
The subjects assessed in long-term trend NAEP are mathematics and reading. Since 2004, the long-term trend assessments have been scheduled to be administered in mathematics and reading every 4 years. The most recent long-term trend assessment was conducted during the 2011-12 school year (fall for age 13; winter for age 9; spring for age 17).
Student survey questions. NAEP also asks questions about students’ characteristics, as well as questions related to the subject area and students’ motivation in completing the assessment. Information is gathered about race/ethnicity, school attendance, academic expectations, and factors related to academic performance.
School Characteristics Survey. This survey collects supplemental data about school characteristics and policies that can be used analytically to provide context for student performance issues and are completed by the principal or assistant principal. The student remains the unit of analysis. Data are collected on such topics as demographic characteristics, classroom experiences, educational support, instructional practices, school policies, students with disabilities, and English-language learners.
Teacher Questionnaire. This survey collects supplemental data from teachers whose students are respondents to the assessment. The first part of the teacher questionnaire tends to cover background and general training, and includes items concerning years of teaching experience, certifications, degrees, major and minor fields of study, course work in education, course work in specific subject areas, the amount of in-service training, the extent of control over instructional issues, and the availability of resources for the classroom. Subsequent parts of the teacher questionnaire tend to cover training in the subject area, classroom instructional information, and teacher exposure to issues related to the subject and the teaching of the subject. Teacher questionnaires are completed by teacher at grade 4 and 8. NAEP typically does not collect teacher information for grade 12.
SD/ELL Survey. This survey is completed in the main NAEP assessments (and the long-term trend NAEP since 2004) by teachers of students who are selected to participate in NAEP and who are classified as either having disabilities (SD) or as English language learners (ELL). Information is collected on the characteristics of each SD/ELL student and the reason for the SD/ELL classification, as well as whether these students receive accommodations in district or statewide tests. For SD students, questions are asked about the student’s functional grade level and special education programs. For ELL students, questions are asked about the student’s native language, time spent in special language programs, and level of English language proficiency. This survey is used to determine whether the student should take the NAEP assessment. If any doubt exists about a student’s ability to participate in the assessment, the student is included. Beginning with the 1996 assessments (2004 for long-term trend), NAEP has allowed accommodations for both SD and ELL students.
High School Transcript Study. Transcript studies have been conducted in 1987, 1990, 1994, 1998, 2000, 2005, and 2009. The studies collect information on current course offerings and course-taking patterns in the nation’s schools for high-school graduates. Transcript data can be used to show course-taking patterns across years that may be associated with proficiency in subjects assessed by NAEP. Transcripts are collected for grade 12 students in schools in the NAEP sample who graduate from the school. (For more information, see the chapter on the High School Transcript Studies.)
National Indian Education Study. The National Indian Education Study (NIES) describes the condition of education for American Indian and Alaska Native (AI/AN) students in the United States. The study was conducted in 2005, 2007, 2009, 2011, and 2015 by NCES on behalf of the U.S. Department of Education, Office of Indian Education. After the 2011 administration of the study, NIES shifted its cycle from once every two years to once every four years. NIES is currently authorized under Executive Order 13592, “Improving American Indian and Alaska Native Educational Opportunities and Strengthening Tribal Colleges and Universities”, which was signed in 2011 to improve education efforts for AI/AN students nationwide. Prior to 2011, NIES was authorized under Executive Order 13336.
NIES has two components: an assessment component and a survey questionnaire component. The assessment component of NIES is conducted through NAEP and provides in-depth information on the academic performance of 4th– and 8th–grade AI/AN students in reading and mathematics. The survey questionnaire component of NIES allows for the description of the educational experiences of the 4th– and 8th–grade AI/AN students who participate in the NAEP assessments. The survey focuses on the integration of native language and culture into school and classroom activities. NIES collects information through questionnaires for students, teachers, and schools.
Other NAEP Special Studies.
In addition to the assessments, NAEP coordinates a number of related special studies. Such studies often involve special data collection procedures in the field, secondary analyses of NAEP results, and evaluations of various technical procedures. A full list and detailed description of each study can be found at http://nces.ed.gov/nationsreportcard/studies/. Examples of such studies are described below.
Main NAEP assesses students at grades 4, 8, and 12 in various subject areas. Students are assessed at grades 4 and 8 in reading and mathematics every two years at both the national and state level. Similar assessments are given in science and writing approximately every four years. Grade 12 assessments are administered less frequently. Subjects other than these four are administered less frequently and at the national level only. The Trial Urban District Assessment, or TUDA, assesses students in large urban districts at grades 4 and 8 in connection with the assessments in reading, mathematics, science, and writing. The NAEP Long-Term Trend Assessment assesses students at ages 9, 13, and 17 in reading and mathematics only and only at the national level. Results go back as far as 1971.