Problem Solving in Technology-Rich Environments (TRE)The Problem Solving in Technology-Rich Environments study (TRE) is one of three field investigations in NAEP's Technology-Based Assessment Project, which explores the use of new technology in administering NAEP. The TRE study was designed to demonstrate and explore an innovative use of computers for developing, administering, scoring, and analyzing the results of NAEP assessments. The purpose of the TRE study was to develop an example set of modules to assess problem solving using technology. These example modules used the computer to present multimedia tasks that cannot be delivered through conventional paper-and-pencil assessments, but do tap important emerging skills. There were two components of the TRE model—a Search module and Simulation module. The TRE Search module presented eighth-grade students with a search tool for locating information on a simulated World Wide Web to solve a series of problems related to the uses and science of gas balloon flight. The TRE Simulation module presented eighth-grade students with a simulation tool for asking "what-if" questions to solve a series of progressively more challenging problems related to the science of gas balloon flight. Although the subject-matter context for the module was physical science, similar measures could be built for other science and social science domains using the TRE model. The TRE pretest took place between mid-March and May 2002, in a sample of schools participating in the NAEP 2002 reading and writing assessments. TRE Assessment ActivitiesIn schools participating in the TRE study, 10 to 12 students gathered information from a simulated World Wide Web universe or ran experiments using a simulation on computers provided by the school or on laptops provided by NAEP. The TRE pretest required approximately 60 to 90 minutes to administer, including distribution and collection of materials. All student names are always kept confidential by NAEP staff. Individual student responses or scores are never reported. The results of the national assessment are reported on the national level and by region of the country, not by school district, school, or individual student. Only group statistics are reported, broken down by gender, race/ethnicity, and a host of variables that illuminate students' instructional experiences. TRE attempted to measure the level of proficiency in both computer skills and science inquiry skills. The TRE pilot test was held in fall 2001, and the pretest occurred in spring 2002. The field test (or final version of the test) took place in spring 2003. Results of the study will be published in the late summer of 2005. Learn about the TRE pilot test. Read about the Writing Online study and the Mathematics Online study.
|
