Title:  Online Assessment in Mathematics and Writing: Reports From the NAEP Technology-Based Assessment Project, Research and Development Series
Description: This document contains reports from the 2001 Math Online (MOL) study and the 2002 Writing Online (WOL) study, both field investigations in the National Assessment of Educational Progress (NAEP) Technology-Based Assessment Project, which explored the use of new technology in NAEP. In the MOL study, nationally representative samples of fourth- and eighth-grade students were administered a computer-based mathematics test and a test of computer facility, among other measures. In addition, at the eighth-grade level, a randomly parallel group of students was administered a paper-based test containing the same items as the computer-based test. Results showed that the computer-based mathematics test was significantly harder than the paper-based test for eighth-grade students. At both grade levels, computer facility predicted online mathematics test performance after controlling for performance on a paper-based mathematics test, suggesting that degree of familiarity with computers may matter when taking a computer-based mathematics test in NAEP. In the WOL study, a nationally representative sample of eighth-grade students was administered a computer-based writing test and a test of computer facility, among other measures. The performance of this sample was compared to a second nationally representative group taking the same writing test in main NAEP. Results showed that average scores on the computer-based writing test were generally not significantly different from average scores on the paper-based writing test. However, as in the Math Online study, computer familiarity was associated with online test performance (after controlling for performance on a paper-based writing test), suggesting that the studentís computer skill level may affect online writing test performance in NAEP.
Online Availability:
Cover Date: August 2005
Web Release: August 18, 2005
Print Release: August 18, 2005
Publication #: NCES 2005457
General Ordering Information
Center/Program: NCES
Authors: Brent Sandene, Nancy Horkay, Randy Elliot Bennett, Nancy Allen, James Braswell, Bruce Kaplan, and Andreas Oranje
Type of Product: Statistical Analysis Report
Survey/Program Areas: National Assessment of Educational Progress (NAEP)
Questions: For questions about the content of this Statistical Analysis Report, please contact:
Taslima Rahman.