Skip Navigation
small NCES header image

What Does the NAEP Science Assessment Measure?

Overview
Science Content
Science Practices
The 1996–2005 Framework
Comparison of the 1996–2005 and 2009 Frameworks

Overview

The National Assessment of Educational Progress (NAEP) 2011 grade 8 science assessment was designed to measure students' knowledge of three broad content areas: physical science, life science, and Earth and space sciences and four science practices: identifying science principles, using science principles, using scientific inquiry, and using technological design. These four practices describe how students use their science knowledge by measuring what they are able to do with the science content.

The content of the NAEP science assessment is guided by the NAEP science framework (9.98 MB PDF). It provides the theoretical basis for the assessment and describes the types of questions that should be included and how they should be designed and scored. As with all NAEP frameworks, the science framework was developed under the guidance of the National Assessment Governing Board with input from hundreds of individuals across the United States, including some of the nation’s leading scientists, science educators, policymakers, and assessment experts

In 2009, a new framework was introduced that replaced the one used for the 1996, 2000, and 2005 science assessments. The 2009 and 2011 assessments were developed using the same framework, allowing the results from the two assessment years to be compared. A variety of factors made it necessary to create a new framework: the publication of National Science Education Standards1 and Benchmarks for Scientific Literacy2, advances in both science and cognitive research, the growth in national and international science assessments, advances in innovative assessment approaches, and the need to incorporate accommodations so that the widest possible range of students can be fairly assessed. 

The assessment resulting from the 2009 framework started a new NAEP science trend line so results from 2009 and 2011 cannot be compared with results of previous science assessments. Whenever changes are made to a framework, efforts are made to maintain the trend lines that permit the reporting of changes in student achievement over time. If, however, the nature of the changes made to an assessment are such that the results would not be comparable to earlier assessments, a new trend line is started. See a comparison of the two frameworks.

Back to Top

Science Content

The framework organizes science content into the following three broad areas reflecting the science curriculum students are generally exposed to across the K-12 curriculum.

  • Physical Science includes concepts related to properties and changes of matter, forms of energy, energy transfer and conservation, position and motion of objects, and forces affecting motion. 
  • LifeScience includes concepts related to organization and development, matter and energy transformations, interdependence, heredity and reproduction, and evolution and diversity. 
  • Earth and Space Sciences includes concepts related to objects in the universe, the history of the Earth, properties of Earth materials, tectonics, energy in Earth systems, climate and weather, and biogeochemical cycles.

Science Practices

In addition to science content, the framework assesses student understanding of how scientific knowledge is used by measuring what students are able to do with the science content. These four science practices describe how science knowledge is used.

  • Identifying Science Principles focuses on students' ability to recognize, recall, define, relate, and represent basic science principles in each of the three content areas.
  • Using Science Principles focuses on the importance of science knowledge in making accurate predictions about and explaining observations of the natural world.
  • Using Scientific Inquiry focuses on designing, critiquing, and evaluating scientific investigations; identifying patterns in data; and using empirical evidence to validate or criticize conclusions.
  • Using Technological Design focuses on the systematic process of applying science knowledge and skills to propose or critique solutions to real world problems, identify trade-offs, and anticipate effects of technological design decisions.

Because of differences in curricular emphasis, the proportion of the assessment devoted to each content area and science practice varies by grade. See the amount of assessment time specified by the framework and devoted in the assessment to each of the three components for grades 4, 8, and 12.

Subscales based on science content (i.e., Physical Science, Life Science, and Earth and Space Sciences) are created at each grade. Subscales are not created based on science practices.

Back to Top

The 1996-2005 Science Framework

The 1996-2005 NAEP science framework specified that the NAEP assessment should assess students in the following areas:

  • knowledge of facts;
  • an ability to integrate this knowledge into larger constructs; and
  • the capacity to use the tools, procedures, and reasoning processes of science to develop an increased understanding of the natural world.

Based on this framework, the science assessment measured and reported subscales for three major fields of science, as follows:

The assessment also measured three characteristic elements of knowing and doing science, as follows:

Each exercise in the science assessment measured content knowledge within one of the fields of science as well as student ability within one of the elements of knowing and doing science (for example, an item may be classified as physical science and conceptual understanding). In addition, one-half of the students in each school received one of three hands-on tasks and related questions. These performance tasks require students to conduct actual investigations using materials provided to them, and to record their observations and conclusions in their test booklets by responding to both multiple-choice and constructed-response questions. For example, students at grade 12 might be given a bag containing three different metals, sand, and salt and asked to separate them using a magnet, sieve, filter paper, funnel, spoon, and water and document the steps they used to do so.  Examples of hands-on tasks used in previous assessments are available in PDF format in the NAEP Questions Tool.

Back to Top

Comparison of the 1996–2005 and 2009 Frameworks 

  1996–2005 Science Framework 2009 Science Framework
Content
  • Organized into Physical Science, Life Science, and Earth Science
  • Framework employed three types of themes: systems, models, and patterns of change
  • Assessment asked questions about the nature of science
  • Organized into Physical Science, Life Science, and Earth and Space Science
  • Framework employs crosscutting content among Life, Physical, and Earth and Space Sciences
Science Practices
  • Knowing and doing dimension organized into conceptual understanding, scientific investigation, and practical reasoning
  • Science practices assessed were largely experience based
  • Assessment included items on practical reasoning (i.e., applying science to suggest effective solutions to everyday problems)
  • Forty-five percent of the assessment focused on conceptual understanding
  • Science practices dimension organized into Identifying Science Principles, Using Science principles, Using Scientific Inquiry, and Using Technological Design
  • Nature of science treated within science practices, particularly Using Science principles and Using Scientific Inquiry
  • Science practices assessed take into account extant research and the cognitive complexity of the items
  • Assessment includes questions on technological design (i.e., the systematic process of applying science knowledge and skills to solve problems in a real-world context)
  • Sixty percent of assessment focuses on conceptual understanding (Identifying and Using Science principles)
  • Learning progressions (i.e., connected sequences of science performances across grade spans) are included
Assessment Items
  • Assessment included both paper-and-pencil and hands-on performance tasks.
  • No illustrative items to convey science knowledge or practices in the framework; only a few suggested ideas for items provided in the specifications
  • Assessment uses the history of science and the relationship between science and technology as contexts for questions
  • Assessment includes paper-and-pencil questions, hands-on performance tasks, and interactive computer tasks
  • Illustrative items that convey science knowledge and practices are included in both the framework and the specifications
  • Framework and specifications include guidelines for assessing students with disabilities and English language learners

1 National Research Council (1996). National Science Education Standards. Coordinating Council for Education, National Committee on Science Education Standards and Assessment. Washington, DC: National Academy Press.
2 American Association for the Advancement of Science (1993). Benchmarks for Science Literacy. New York: Oxford University Press.

Back to Top


Last updated 31 March 2012 (JM)
Would you like to help us improve our products and website by taking a short survey?

YES, I would like to take the survey

or

No Thanks

The survey consists of a few short questions and takes less than one minute to complete.
National Center for Education Statistics - http://nces.ed.gov
U.S. Department of Education