Skip to main content
Skip Navigation
  • Home
  • Digitally Based Assessments

Digitally Based Assessments

  • NAEP Field Staff transporting tablets for digitally based assessments in Alaska.
  • NAEP digitally based assessment in the classroom.
  • Students participating in NAEP digitally based assessments.

Today’s students are digital natives. Their schools are usually equipped with computers, and digital tools are an integral part of the learning environment. To address the increased role of technology in classrooms, the National Center for Education Statistics (NCES) is transitioning the National Assessment of Educational Progress (NAEP) from paper and pencil to digitally based assessments. NCES is utilizing established best practices for NAEP to remain at the forefront of innovation for large-scale assessments. NCES is also exploring new testing methods and question types to reflect the growing use of technology in education.

NAEP digital assessments, which are administered on tablets or laptop computers, use dynamic and innovative technologies to provide an engaging assessment experience for students and more meaningful data about students’ skills and knowledge for educators. With digitally based assessments, students are asked to receive, gather, and report information just as they do in their everyday lives. These new assessments include universal design principles, making it possible for more students to participate without special accommodation sessions. The goal is for all students to have a seamless assessment administration, regardless of their ability. These goals and more are highlighted in the video below.

Experience a Digitally Based Assessment

Experience a digitally based assessment by watching the tutorials that are given to students before taking an assessment. In addition, view the sample questions and student responses from previous assessments, explore interactive tasks, and download the survey questionnaires that are given to participants of NAEP assessments.

Learn More

What's Happening Now

DBA Classroom Setup

Results of the 2018 NAEP digitally based assessments in civics, geography, U.S. history, and technology and engineering literacy (TEL) are being analyzed and will be reported on a national level in 2019. The civics, geography, and U.S. history assessments were administered on NAEP-provided tablets at grade 8 in the winter of 2018. A small number of eighth-grade students took paper-and-pencil assessments in these subjects to help NAEP evaluate any differences in student performance between the two types of administration. The NAEP TEL assessment was administered to eighth-graders on laptops in 2018. 

Select fourth-grade students participated in reading special studies or a science pilot assessment; some eighth-grade students participated in a reading special study or science pilot assessment; and some twelfth-grade students participated in a mathematics pilot assessment, reading pilot assessment, reading special study, or science pilot assessment. Results from these pilot assessments will not be released but will be used to inform future NAEP assessments. Additional subjects will be administered on tablets in 2019. Each student will take NAEP in one format and one subject only.

Transition to Digitally Based Assessments

DBA in the classroom

Since 2001, NAEP has been exploring new testing methods and question types that reflect the growing use of technology in education. NAEP has introduced a variety of new question and task types in the assessments to capture what students know and are able to do in more authentic or direct ways, including scenario-based tasks from the technology and engineering literacy (TEL) assessment, interactive computer tasks, and hybrid hands-on tasks.

In 2016, NAEP mathematics and reading assessments were piloted on tablets with an attached keyboard, a stylus, and earbuds and used new testing methods and question types. Some questions included multimedia, such as audio and video. Other questions allowed the use of digital tools (such as an onscreen calculator) to form a response, or engaged students in solving problems within realistic scenarios.

Research in the use of new technologies is ongoing throughout the introduction of digitally based assessments.

New technologies are improving NAEP’s ability to offer accommodations to increase participation and provide universal access to students of all learning backgrounds, including students with disabilities and English language learners. In a digital environment, what used to be an accommodation for paper-based testing becomes a seamless part of universal design, available to all students. That means that things like adjusting font size, having test questions read aloud in English (text-to-speech), use of higher contrast to improve readability, and using a highlighter tool are available to all students during the assessment.

Commissioner's Statement

See the statement from NCES Acting Commissioner, Dr. Peggy G. Carr, discussing the NAEP transition to digitally based assessments.

Learn More

Maintaining Trend

Maintaining trend lines (the ability to compare performance results from one year to another) is a priority. To do this, NAEP is using a multistep process to move from paper to digital technology to protect trend reporting. The process involves two stages of piloting before administering an operational digitally based NAEP assessment:

  • Stage 1. Adapt the paper-based questions for tablet delivery and pilot them in the same year as a main paper-based NAEP administration. Comparing results from paper and digitally based versions of the same assessment content will allow NAEP to establish a link between administration modes and help interpret performance trends across the transition from paper to digital delivery.
  • Stage 2. Develop new assessment questions and innovative question types and tasks that make use of digital technologies. This new digital assessment content will be gradually introduced into the assessment after first studying the effects of including these new items and item types.

Watch a Tutorial

En Español
Digitally based assessment tutorial.
Digitally Based Assessment 2018 Tutorial.

The transition of NAEP assessments from pencil and paper to touch-screen tablets incorporates cutting-edge learning technologies. At the beginning of each assessment, students take a brief, interactive tutorial designed to teach them about the system and the tools they use to take the assessment. Some of the on-screen, interactive tools may be familiar to students, while others are unique to the NAEP assessment. Each assessment begins with a short tutorial that demonstrates these tools so that students may use them effectively during the assessment. Parts of the tutorial are the same across grades and subjects, while others are specific to each subject.

You can now experience the same tutorial, either on a tablet or computer, shown to students at the beginning of a NAEP assessment. Tutorials for the 2018 assessments are available through the link below. Following an introductory video , you can access the tutorials that cover mathematics at grade 12; reading and science at grades 4, 8, and 12; and civics, geography, and U.S. history at grade 8.

The tutorial experienced by students during the 2018 eNAEP assessment is designed for a particular tablet and using a specific screen size. You may need to make one or more of the following adjustments in order to ensure an optimal viewing experience:

  • Please view the tutorial using a device with a 12-inch or larger screen.
  • This tutorial cannot be navigated exclusively with your keyboard.
  • You may need to use your browser's zoom feature to fit the tutorial to your screen.
  • The tutorial cannot be viewed using the Firefox browser.

2017 Tutorials

View the 2017 tutorials for mathematics, reading, and writing at grades 4 and 8; and social studies at grade 8.

Learn More

Frequently Asked Questions

Why did NAEP move to digitally based assessments?

Schools are increasingly using technology in the classroom to teach and assess students. NAEP assessments are moving forward to align with school practices.

In addition, this move will allow NAEP to:

  • Use tools available in digital platforms to measure content in new ways;
  • Use assistive technology to provide enhanced accommodations for students with special needs;
  • Collect new types of data that deepen our understanding of what students know and can do, including how they engage with new technologies to approach problem solving;
  • Make the assessments potentially more engaging to the students; and,
  • Align with the delivery mode of many other large-scale assessments.
How did NAEP leverage new technologies to measure and analyze the skills of a new generation of students?

Across the program, NAEP has introduced a variety of new tasks in the assessments, such as scenario-based tasks and interactive computer tasks. These tasks ask students to engage with real-world problems or situations and to work through a series of questions to demonstrate what they know and are able to do in ways that more accurately reflect what is happening in today’s classrooms.

NAEP’s digitally based assessment tasks reflect the growing use of technology in education. Some tasks may include multimedia, such as audio and video. Others may allow the use of embedded technological features (such as an equation editor) to form a response.

These new assessment characteristics are expected to allow NAEP to capture information about students’ problem-solving processes and the strategies they use when responding to assessment questions. For example, while a paper-based assessment would only yield the final responses in the test booklet, digitally based assessments can capture information about students’ use of the tools and whether students change their answer. Thus, digitally based assessments expand what NAEP can learn about the performance of both successful and less successful students.

What types of universal design features and accommodations are available in digitally based assessments?

The transition to digitally based assessments will allow NAEP to make various universal design features available to all students, and to use assistive technology to offer accommodations for students with special needs. In a digital environment, what was previously an accommodation in paper-based testing becomes a seamless part of universal design. That means that features like adjusting font size, having test items read aloud in English (text-to-speech), changing the appearance of the testing interface to have a higher contrast, and using a highlighter tool, are available to all students during the test administration.

In addition to these universal design features, NAEP continues to offer accommodations required in students’ Individualized Education Program (IEP) and 504 plans. Some accommodations are available in the testing system (such as additional time or bilingual forms of the questions in mathematics), while others are provided by the test administrator or the school (such as breaks during testing or sign language interpretation of the test).

Does NAEP have experience administering assessments using technology?
Digitally Based Assessments Timeline

NAEP began conducting studies to support the transition to digitally based assessments (DBA) in 2001. Initial research was conducted during 2001 through 2003. These investigations included a math online study, a writing online study, and a problem solving in technology-rich environments study. From 2008 through 2015, NCES incorporated technology in a variety of assessments to have a broader coverage of new frameworks. These assessments include science interactive computer tasks, writing, and technology and engineering literacy (TEL) — all of which require students to interact with digitally based platforms. Additionally, in 2015, NAEP began conducting digitally based pilot studies to gather data to support the transition to DBA. Over the next several years, all NAEP subjects will transition to DBA. The graphic below highlights milestones in NAEP’s exploration of digitally based assessments.

How are NAEP’s digitally based assessments set up and administered in schools?
Digitally Based Assessments in the Classroom

A team of approximately 3 - 4 NAEP field staff set up and administer the assessments. NAEP provides all necessary equipment including student tablets with an attached keyboard, stylus, earbuds, an administrator tablet, and a router that provides a closed wireless network for the devices to communicate. Schools are asked to provide space, desks or tables, and access to electrical outlets. Schools do not need to provide internet access. Two sequential sessions are conducted at each sampled school, with approximately 25 students in each session. The graphic below illustrates the setup and flow of data during the administration.

How does NAEP address differences in students’ levels of experience with digital technology?

NAEP assessments are designed to test the knowledge and skills that are relevant to the content area being tested and not to test students’ proficiency with technology. NAEP conducted cognitive laboratories and play testing with students during the development of the digitally based platform. To support students’ interaction with the digital assessment, NAEP offers tutorials before the assessment that allow test-takers to become familiar with the system, its tools, and its functionality. These tutorials provide demonstrations of the assessment platform and tools and allows students to have hands-on experience before the assessment begins. The tutorials are available to the public online, allowing participants to become familiar with the digital platform. Additionally, there are help screens built into the system that students can access at any time during the assessment. Finally, NAEP is conducting research to investigate the relationship between student performance and computer access and familiarity.

Why did some students take the NAEP mathematics and reading assessments in paper-and-pencil form in 2017?

Some students in each state and urban district took the paper-and-pencil forms of the assessment in 2017 in order to investigate potential differences between digitally based and paper-and-pencil administrations within the same year.

What is the timeline for reporting 2017 reading and mathematics scores?

The 2017 transition to digitally based assessments in reading and mathematics at grades 4 and 8 will lengthen the period between administration and reporting results that states and districts have previously experienced. NCES plans to extend the typical six-month window for the reporting of 2017 NAEP mathematics and reading results. The extension of the reporting timeline is necessary to allow for the additional analyses required because of the administration of both digitally based and paper-and-pencil assessments. Results are expected to be released in early 2018. Future grade 4 and 8 mathematics and reading results should be released under the traditional six-month reporting timeframe.

What special analyses are being conducted in 2017 to continue to report on student progress?

NCES designed the 2017 assessment to ensure the move from a paper-based assessment to a digitally based assessment did not compromise our ability to report on student progress. As reported by other large-scale assessments, student performance generally differs when the assessment mode changes. NCES examined this potential mode effect in NAEP with a set of rigorous analyses.

In 2017, random samples of students took either the paper or digital version of the reading or mathematics assessment in each state and participating urban district. NCES then compared the performance of all students and student groups (e.g., race/ethnicity, gender) nationally, as well as for states and large urban districts. These analyses will determine whether specific states, districts, or student groups in the nation are impacted differently given the NAEP transition to digitally based assessments.

Have the NAEP frameworks and items changed since the test is being delivered digitally?

The impact of the transition to digitally based assessments on the NAEP frameworks varies by subject. For example, the technology and engineering literacy (TEL) framework was originally written for digital administration; both the science and the writing frameworks have been changed to address the transition to digitally based assessment; and, the frameworks for reading, mathematics, and the social sciences have not changed. However, the item types used during NAEP paper-and-pencil administrations were limited to two formats: multiple choice and constructed response (short or extended). Digitally based administrations allow for the inclusion of other types of selected-response items, such as multiple- choice questions where more than one correct answer can be selected; items where students drag and drop elements to complete a matching or ordering task; questions where students select an area of an image (such as a map or graph) rather than selecting a traditional text option; and, some additional interactive tools that have been deemed appropriate for assessing the content knowledge, skills, and abilities described in the frameworks.

How does NAEP protect the personal information of students and schools?

Federal law dictates complete privacy for all test-takers and their families. Under the National Assessment of Educational Progress Authorization Act (Public Law 107-279 III, section 303), the Commissioner of the National Center for Education Statistics (NCES) is charged with ensuring that NAEP assessments do not ask test-takers about their personal or family beliefs or make their personal identity information publicly available.

Last updated 24 May 2018 (FW)