- Surveys & Programs
- Data & Tools
- Fast Facts
- News & Events
- Publications & Products
- About Us
 |
|
|||||||||||||||||||||||||
Download and View PDF Version of this Report| United States National Coordinating Committee: | |
| Eugene Owen | William Schmidt |
| Lois Peak | Larry Suter |
| Contributors: | |
| Nancy Caldwell | Molly Soule |
| Leland Cogan | Brian Thompson |
| Margaret Cozzens | Gilbert Valverde |
| Leslie Jocelyn | Pamela Warner |
| David Kastberg | Christine Welch |
| John Konstant | Trevor Williams |
| David Nohara | |
Initial Findings from the
Third International Mathematics and Science Study
| U.S. Department of Education Richard W. Riley Secretary Office of Educational Research and Improvement
|
Data Development and Longitudinal Studies Group Martin E. Orland Associate Commissioner International Activities Program |
The (NCES) is the primary federal entity for collecting, analyzing, and reporting data related to education in the United States and other nations. It fulfills a congressional mandate to collect, collate, analyze, and report full and complete statistics on the condition of education in the United States; conduct and publish reports and specialized analyses of the meaning and significance of such statistics; assist state and local education agencies in improving their statistical systems; and review and report on education activities in foreign countries.
NCES activities are designed to address high priority education data needs; provide consistent, reliable, complete, and accurate indicators of education status and trends; and report timely, useful, and high-quality data to the U.S. Department of Education, the Congress, the states, other education policy makers, practitioners, data users, and the general public.
We strive to make our products available in a variety of formats and in language that is appropriate to a variety of audiences. You, as our customer, are the best judge of our success in communicating information effectively. If you have any comments or suggestions about this or any other NCES product or report, we would like to hear from you. Please direct your comments to:
National Center for Education Statistics
Institute of Education Sciences
U.S. Department of Education
1900 K Street NW, Suite 9000
Washington DC 20006
e-mail: timss@ed.gov
Suggested Citation:
U.S. Department of Education. ,
Pursuing Excellence: A Study of U.S. Twelfth-Grade
Mathematics and Science Achievement in International Context,
NCES 98-049. Washington, DC: U.S. Government Printing Office,
1998.
February 1998
REVISED August 1998
Available for downloading at //timss
The authors wish to thank all those who contributed to the production of this report through their insightful suggestions. The invited reviewers who gave of their time and expertise included: Susan Fuhrman of the University of Pennsylvania; Henry Heikkinen of the University of Northern Colorado; Mary Lindquist of Columbus State University; Laura Lippman of NCES; and Robert Burton of NCES. We would also like to thank the many other individuals both within and outside the Department of Education who provided helpful comments during the development of this report.
The Third International Mathematics and Science Study (TIMSS) is the largest, most comprehensive, and most rigorous international study of schools and student achievement ever conducted. This report, Pursuing Excellence: A Study of U.S. Twelfth-Grade Mathematics and Science Achievement in International Context, compares the general mathematics and science knowledge of our students in their last year of secondary school with those of 20 other countries, as well as the achievement of our students taking physics and advanced mathematics courses with those in 15 other countries. It is the last of three major TIMSS reports by the (NCES) in its Pursuing Excellence series. The first report, outlining U.S. comparative eighth-grade results, was released in November 1996, and the second report, detailing fourth-grade results, was released in June 1997. Together, these three studies paint the most complete picture ever of how achievement in mathematics and science by U.S. students compares with that of other nations. The information is intended to help U.S. educators, parents, policymakers, and others evaluate the strengths and weaknesses of our schools from an international perspective. This comparative portrait can be used to examine our education system, scrutinize improvement plans, and evaluate proposed standards and curricula.
The scope of TIMSS is unprecedented in the annals of education research. The international project involved the testing of more than one-half million students in mathematics and science at three grade levels in 41 countries. In contrast to previous international comparative studies, TIMSS also goes beyond the traditional "horserace" data on student performance to explore possible causes for differences in achievement including questions on students' lives inside and outside of the classroom.
This wealth of data is being analyzed and published by NCES and others around the world. TIMSS has become the most accessible international education study ever by releasing information in a variety of new forms, including CD-ROM, videotape, and the World Wide Web (//timss). We invite everyone who is dedicated to enhancing the quality of our nation's mathematics and science education to make the fullest possible use of this rich resource.
Together, the various TIMSS reports constitute important tools that can improve the quality of primary and secondary education for all students. That is why the Center has worked cooperatively with other parts of the U.S. Department of Education to produce a multi-media resource kit designed for educators and those interested in using TIMSS data to improve teaching, curricula, and student achievement in states and local communities. We also will be conducting a follow-up study in 1999, when the students who took TIMSS in the fourth grade have reached the eighth grade, both to compare their performance with the 1995 eighth-grade results, and to assess the level of progress made by this group of students over the intervening four years.
The TIMSS data provide a reference point from which we can begin to clarify what we mean by "world-class" education. They give us tools by which we can benchmark not only the performance of our students but also the way in which we deliver instruction. Most importantly, they allow the U.S. to learn unique lessons from other members of the world community so that we may better pursue the goal of an excellent education for all students.
Pascal D. Forgione, Jr.
Commissioner of Education Statistics
February 1998
The Third International Mathematics and Science Study (TIMSS) was designed explicitly to enable educators and policy makers to compare achievement in science and mathematics of students in the United States with those in other countries at three levels of education, grades 4, 8, and the final year of secondary school (grade 12 in the U.S.). With this publication of the results of the 1995 assessment of the final year of secondary school, TIMSS has been successful. In addition, differences in student learning and characteristics of schooling, as measured by the TIMSS assessment instruments and questionnaires, enhance our understanding of the possible influences of such factors as school organization, teaching practices, student study habits, and family background. But the secrets of raising the level of student achievement beyond their current levels are not readily uncovered, and this study provides no easy answers or quick fixes.
The results of students in the final year of secondary school in the TIMSS science and mathematics general knowledge assessments found that our students performed less well than they did at grade 8, significantly below the international mean. In addition, U.S. most advanced students (those taking pre-calculus or calculus and those taking physics) performed at low levels in advanced mathematics and at especially low levels in physics when compared with similar students in other countries.
Once the results for all grades are considered, we see that U.S. students in the early school years have reasonable levels of achievement when compared with other countries--in science they are actually rated near the top--but performance lags by grade 8 and becomes even poorer at grade 12. The report's new information about advanced students should be reviewed carefully by college and university policy makers as well as those who influence coursetaking and career decisions made during the high school years.
Results of the advanced mathematics test reveal some unexpected weaknesses. Despite the fact that about one-quarter of the test related to calculus and that one-half of the U.S. advanced mathematics students were actually studying calculus, it was in geometry, not calculus, where U.S. students performed worst. This is consistent with performance in grades 4 and 8, but unexpected because these advanced students have all had formal geometry coursework. The results show that both geometry and algebra need to be key subjects of study throughout the curriculum.
For me, as a physicist with a keen interest in education, the science results are even more troubling. Students performed poorly in most sub-areas of physics, with the poorest performance coming on items on mechanics and electricity/magnetism (areas that account for about 75 percent of American physics textbooks). Even students who took an Advanced Placement physics course scored below the international norm.
These studies suggest that students appear to disengage from learning critical mathematics and science content as they progress through the school system. The sources of disengagement may include the classroom environment, the quality of instruction, and parental and community support for the value of science and mathematics to our children's future.
Improving achievement in mathematics and science subjects, whether in basic skills or advanced critical thinking, will require that students have, in combination, access to good teachers, good teaching materials, and agreement within the school on the goals of learning for all students. There are many efforts underway in states and localities throughout the United States to reform the process of teaching and learning mathematics and science. They are beginning to reveal mechanisms for obtaining gains in achievement. TIMSS also provides us with examples of nations with high performance at all grade levels, most notably Canada, the Netherlands, and Switzerland. American educators need to examine these successful efforts, learn from them, and effectively use all available resources to improve teaching and learning in mathematics and science at all grade levels.
Neal Lane, Director
National Science Foundation
February 1998
INTRODUCTION
- The Third International Mathematics and Science Study (TIMSS) is the largest, most comprehensive, and most rigorous international comparison of education ever undertaken. During 1995, the study assessed the mathematics and science knowledge of a half-million students from 41 nations at three levels of schooling.
- The information in this report is about students who were assessed at the end of twelfth grade in the United States and at the end of secondary education in other countries. It includes four areas of performance: mathematics general knowledge, science general knowledge, physics, and advanced mathematics.
- This report on students in the final year of secondary school is the last in a series of three public-audience reports titled Pursuing Excellence. The first report presented findings on student achievement at eighth grade. The second report presented findings from the fourth grade.
- TIMSS is a fair and accurate comparison of mathematics and science achievement in the participating nations. The students who participated in TIMSS were scientifically selected to accurately represent students in their respective nations. The entire assessment process was scrutinized by international technical review committees to ensure its adherence to established standards. Those nations in which irregularities arose, including the United States, are clearly noted in this and other TIMSS reports.
- Criticisms of previous international studies comparing students near the end of secondary school are not valid for TIMSS. Because the high enrollment rates for secondary education in the United States are typical of other TIMSS countries, our general population is not being compared to more select groups in other countries. Further, the strict quality controls ensured that the sample of students taking the general knowledge assessments was representative of all students at the end of secondary school, not just those in academically-oriented programs.
- This report consists of three parts: initial findings from the assessments of mathematics and of science general knowledge; initial findings from assessments of physics and of advanced mathematics; and initial findings about school systems and students' lives; and how those are associated with the relative performance of U.S. students compared to those in other cultures.
ACHIEVEMENT OF ALL STUDENTS
- A sample of all students at the end of secondary school (twelfth grade in the United States) was assessed in mathematics and science general knowledge. Mathematics general knowl-edge and science general knowledge are defined as the knowledge of mathematics and of science needed to function effectively in society as adults.
- U.S. twelfth graders performed below the international average and among the lowest of the 21 TIMSS countries on the assessment of mathematics general knowledge. U.S. students were outperformed by those in 14 countries, and outperformed those in 2 countries. Among the 21 TIMSS nations, our students' scores were not significantly different from those in 4 countries.
- U.S. twelfth graders also performed below the international average and among the lowest scoring of the 21 TIMSS countries on the assessment of science general knowledge. U.S. students were outperformed by students in 11 countries. U.S. students outperformed students in 2 countries. Our students' scores were not significantly different from those of 7 countries, including France, Germany, Italy, and the Russian Federation.
- The international standing of U.S. students was stronger at the eighth grade than at the twelfth grade in both mathematics and science among the countries that participated in the assessments at both grade levels.
- The U.S. international standing on the general knowledge component of TIMSS was higher in science than in mathematics. This pattern is similar to the findings at fourth and eighth grades in TIMSS.
- The U.S. was one of three countries that did not have a significant gender gap in mathematics general knowledge among students at the end of secondary schooling. While there was a gender gap in science general knowledge in the United States, as in every other TIMSS nation except one, the U.S. gender gap was one of the smallest.
ACHIEVEMENT OF ADVANCED STUDENTS
- The advanced mathematics assessment was administered to students who had taken or were taking pre-calculus, calculus, or AP calculus in the United States and to advanced mathematics students in other countries. The physics assessment was administered to students in the United States who had taken or were taking physics or AP physics and to advanced science students in other countries.
- Performance of U.S. physics and advanced mathematics students was among the lowest of the 16 countries which administered the physics and advanced mathematics assessments. In physics, 14 countries outperformed the United States; no countries performed more poorly. In advanced mathematics, 11 countries outperformed the United States and no countries performed more poorly.
- In all five content areas of physics and in all three content areas of advanced mathematics, U.S. physics and advanced mathematics students' performance was among the lowest of the TIMSS nations.
- In both physics and advanced mathematics, males outperformed females in the United States and most of the other TIMSS countries.
- More countries outperformed the United States in physics than in advanced mathematics. This differs from the results for mathematics and science general knowledge, as well as the results at grades 4 and 8, where more countries outperformed the United States in mathematics than in science.
CONTEXTS OF LEARNING
- It is too early in the process of data analysis to provide strong evidence to suggest factors that may be related to the patterns of performance at the end of secondary schooling described here.
- Although secondary education in the United States differs structurally in important dimensions from that in many of the other countries, in this first analysis, few of those structural differences are clearly related to the relatively poor performance of our twelfth graders on the TIMSS assessments.
- Although the lives of U.S. graduating students differ from those of their peers in other countries on several of the factors examined, few appear to be systematically related to our performance in twelfth grade compared to the other countries participating in TIMSS.
- Further analyses are needed to provide more definitive insights on these subjects.
CONCLUSIONS
- U.S. students' performance was among the lowest of the participating countries in mathematics and science general knowledge, physics, and advanced mathematics.
- TIMSS does not suggest any single factor or combination of factors that can explain why our performance at twelfth grade is low relative to other countries at the end of secondary education.
- From our initial analyses, it also appears that some factors commonly thought to be related to individual student performance are not strongly related to national averages of student performance at the end of secondary school in TIMSS.
- TIMSS provides a rich source of information about student performance in mathematics and science, and about education in other countries. These initial findings suggest that to use the study most effectively, we need to pursue the data beyond this initial report, taking the opportunity and time to look at interrelationships among factors in greater depth.
Questions, problems or comments with this Web site?
Contact timss@ed.gov.
