Eugene G. Johnson, Educational Testing Service

 

 

---

 

National Center for Education Statistics

The National Center for Education Statistics (NCES) is the primary federal entity for collecting, analyzing, and reporting data related to education in the United States and other nations. It fulfills a congressional mandate to collect, collate, analyze, and report full and complete statistics on the condition of education in the United States; conduct and publish reports and specialized analyses of the meaning and significance of such statistics; assist state and local education agencies in improving their statistical systems; and review and report on education activities in foreign countries.

NCES activities are designed to address high priority education data needs; provide consistent, reliable, complete, and accurate indicators of education status and trends; and report timely, useful, and high quality data to the U.S. Department of Education, the Congress, the states, other education policymakers, practitioners, data users, and the general public.

We strive to make our products available in a variety of formats and in language that is appropriate to a variety of audiences. You, as our customer, are the best judge of our success in communicating information effectively. If you have any comments or suggestions about this or any other NCES product or report, we would like to hear from you. Please direct your comments to:

National Center for Education Statistics
Institute of Education Sciences
U.S. Department of Education
1900 K Street NW, Suite 9000
Washington DC 20006

The NCES World Wide Web Home Page is http://nces.ed.gov

Suggested Citation:

U.S. Department of Education, National Center for Education Statistics. Linking the National Assessment of Educational Progress (NAEP) and the Third International Mathematics and Science Study (TIMSS): A Technical Report, NCES 98-499, by Eugene G. Johnson. Project Officer, Eugene Owen. Washington, DC: Government Printing Office, September 1998.

Contact:
Arnold Goldstein

 

The Research and Development series of reports has been initiated for the following goals:

1. To share studies and research that are developmental in nature. The results of such studies may be revised as the work continues and additional data become available.
2. To share results of studies that are, to some extent, on the cutting edge of methodological developments. Emerging analytical approaches and new computer software development often permit new, and sometimes controversial, analysis to be done. By participating in "frontier research," we hope to contribute to the resolution of issues and improved analysis.
3. To participate in discussions of emerging issues of interest to educational researchers, statisticians, and the Federal statistical community in general. Such reports may document workshops and symposiums sponsored by the National Center for Education Statistics (NCES) that address methodological and analytical issues or may share and discuss issues regarding NCES practice, procedures, and standards.

The common theme in all three goals is that these reports present results or discussions that do not reach definitive conclusions at this point in time, either because the data are tentative, the methodology is new and developing, or the topic is one on which there are divergent views. Therefore, the techniques and inferences made from the data are tentative and are subject to revision. To facilitate the process of closure on the issues, we invite comment, criticism, and alternatives to what we have done. Such responses should be directed to:

 

 

This report benefited greatly from the contributions of many people.

My plans about linking NAEP and TIMSS and estimating the components of variance of the link were greatly clarified through conversations with Robert Mislevy, Don McLaughlin, and Juliet Shaffer, all of whom also made insightful comments on successive drafts of the report. Helpful comments on the report were also made by Susan Ahmed, Albert Beaton, James Chromy, Jon Cohen, John Dossey, Paul Holland, Richard Jaeger, Lyle Jones, Wayne Martin, Ingram Olkin, Senta Raizen, Douglas Rindone, Keith Rust, David Thissen, and Valerie Williams.

Data analysis was led by Minhwei Wang, with significant contributions by David Freund, Xuefei Hui, Edward Kulick, and Steve Wang. Gerry Kokolis and Jennifer Nelson created the graphics in the report. Sincere thanks also go to Eugenio Gonzalez and Stephen Roey for providing the needed TIMSS data.

This report was funded through the National Center for Education Statistics (NCES) in the Office of Educational Research and Improvement of the U.S. Department of Education. Pascal Forgione, NCES Commissioner, provided support and guidance. Advice and guidance was collegially provided by Mary Frase, Arnold Goldstein, Marilyn McMillen, Martin Orland, Eugene Owen, Lois Peak, and Gary Phillips. I am also grateful to Ramsey Selden, Karol Krotki, and Patrick Gonzales of the Education Statistics Services Institute for their help.

Thanks to Adriene Siegendorf of the Education Statistics Services Institute, and my co-author of the Results Report, for the tables comparing the states to the nations.

Special thanks go to Nancy Caldwell of Westat for her support, encouragement, and insight throughout the process of creating this report.

Finally, thanks go to Susan Crawford of Westat and Janet Johnson formerly of the Educational Testing Service for editorial support, and a particular thanks to Joan Murphy of Westat, who edited and oversaw the production of the many drafts, up to and including the final report.

Eugene Johnson

 

Chapter

Appendix

Table