Skip Navigation
small NCES header image

Illustration/Logo View Quarterly by  This Issue  |  Volume and Issue  |  Topics
Education Statistics Quarterly
Vol 5, Issue 1, Topic: Featured Topic: The TIMSS 1999 Video Study
Invited Commentary: Lessons Learned From Examining Mathematics Teaching Around the World
By: Edward A. Silver, Professor of Education and Mathematics, University of Michigan
 
This commentary represents the opinions of the author and does not necessarily reflect the views of the National Center for Education Statistics.
 
 

National and international assessments of student achievement provide ample evidence that American students learn far less mathematics than is desired. For example, in the most recent National Assessment of Educational Progress (NAEP) mathematics assessment, only about one-fourth of American 4th- and 8th-grade students performed at or above the Proficient level, and the percentage was even lower for students in grade 12 (Braswell et al. 2001). Moreover, findings from the Third International Mathematics and Science Study (TIMSS) 1995 and 1999 mathematics assessments indicate that U.S. students at grade 8 performed below the level attained by students in many other developed nations of the world (Beaton et al. 1996; Mullis et al. 2000; Schmidt et al. 1999). In response to findings such as these, a number of initiatives have been proposed to raise the mathematics achievement of U.S. students.

There is widespread agreement that higher student achievement is unlikely to occur unless and until higher quality teaching becomes more prevalent in U.S. classrooms (National Commission on Teaching and America’s Future 1996; U.S. Department of Education 2000). Thus, it is common for educators and policy-makers to design initiatives aimed at leveraging higher student achievement by enhancing the quality of mathematics teachers and teaching. And the clamor for improving teacher quality is not restricted to professionals within the field of education. A recent survey of American adults regarding education issues found that teaching quality was one of the major concerns of the American public (Educational Testing Service 2002).

Despite the strong desire to improve the quality of mathematics teaching in the United States, designers of educational improvement initiatives lack a complete picture of instructional practices at this time. What is known about instructional practices in American mathematics classrooms comes almost entirely from two types of sources: observational data collected in studies of relatively small numbers of teachers and classrooms, and teacher self-report data collected in large-scale surveys of mathematics teachers. Large-scale surveys, such as those conducted by NAEP (Braswell et al. 2001) and by Horizon Research (Weiss et al. 2001), have been a primary source of information for educators in constructing portraits of mathematics teachers and their instructional practices (e.g., Grouws and Smith 2000). These sources of information are valuable, but they are limited due either to their small samples or to the indirect nature of the evidence provided. Similarly, some other valuable sources of data drawn from large-scale, direct observation in classrooms (e.g., Stake and Easley 1978) are now quite dated. Efforts to improve mathematics instruction (and, ultimately, students’ mathematics achievement) are likely to be hampered by this limited corpus of credible data regarding the current nature and quality of teaching.

A notable exception to the general lack of first-hand data on mathematics teaching practices in U.S. classrooms is provided by the TIMSS 1995 Video Study (Stigler et al. 1999; Stigler and Hiebert 1999), in which a relatively large sample of mathematics lessons from Germany, Japan, and the United States were analyzed. This study pointed to distinct styles of mathematics teaching in the three countries considered and identified some differences between mathematics teaching in the United States and in Japan that might be related to the large student performance differential between the two countries.

In addition, the corpus of data on current mathematics teaching in the United States and in many other parts of the world has just been enriched by the release of findings on mathematics teaching from the TIMSS 1999 Video Study, which is a successor to and expansion of the TIMSS 1995 Video Study. The 1999 study expanded the number of countries under consideration from three to seven and included more countries with high achievement on TIMSS assessments in comparison to the United States.

back to top


Methods and findings of the TIMSS 1999 Video Study are provided in a recently released National Center for Education Statistics (NCES) report, Teaching Mathematics in Seven Countries: Results From the TIMSS 1999 Video Study, featured in this issue of the Education Statistics Quarterly. The study involved an analysis of 638 eighth-grade mathematics lessons. One randomly selected mathematics lesson was videotaped in each school in a nationally representative sample of schools in Australia, the Czech Republic, Hong Kong SAR,* the Netherlands, Switzerland, and the United States. In addition, the lessons collected in Japan for the TIMSS 1995 Video Study were reanalyzed as part of the 1999 study. Students from these countries were among the highest performers on the TIMSS assessments of mathematics achievement in 1995 and 1999. In 1995, eighth-graders in all of these countries scored significantly higher than did U.S. eighth-graders. In 1999, U.S. eighth-graders were again outperformed by eighth-graders in all of the countries except Switzerland (which did not participate in the 1999 assessment) and the Czech Republic (which experienced a decline in scores between 1995 and 1999).

The multidimensional analyses of the videotaped lessons revealed not only some similarities in mathematics teaching across the countries but also a number of discernable differences. For example, eighth-grade mathematics lessons were generally organized similarly in all countries to include some public work involving the whole class and some private work, with students usually working individually and occasionally working in small groups. But mathematics lessons varied across the countries in the way that time was distributed to the review of previously learned material, to the introduction of new content, and to practice on new content. Other differences across countries were noted in the way that instructional time was allocated to various kinds of mathematical activities—using procedures, stating concepts, and making connections among facts, concepts, or procedures—and the patterns of transformation that were evident between the original presentation of the task by the teacher and the eventual enactment by the students in the classroom.

The information available in Teaching Mathematics in Seven Countries will undoubtedly be useful both to researchers who study mathematics teaching and to the designers of educational interventions intended to transform and enhance current teaching practices, especially when considered in light of findings available from other research studies. For example, the findings of the TIMSS 1999 Video Study supplement and reinforce findings of other analyses of classroom instruction (e.g., Stein, Grover, and Henningsen 1996; Henningsen and Stein 1997) that have pointed to the tendency in U.S. classrooms for teachers to transform intellectually demanding tasks in ways that reduce the cognitive challenge for students. Given that patterns and factors associated with this transformation of cognitive demands have been related to student achievement (Stein and Lane 1996) and to teacher professional development (Stein et al. 2000), the findings of the TIMSS 1999 Video Study with respect to this and other aspects of classroom instruction should be of great interest.

From an international comparative perspective, a major finding of the study is that no single method of mathematics instruction was observed in all of the high-performing countries examined. With respect to most features of instruction—including some that have been hotly debated in the United States, such as using calculators or embedding mathematics problems in applied contexts—there was considerable variation in the teaching observed across the sample of countries with high-performing students on the TIMSS mathematics assessments. The findings of the TIMSS 1999 Video Study might help to quell the so-called math wars, in which proponents of one view of mathematics instructional reform do battle with opponents of that view. A careful examination of the findings of the TIMSS video study report, and a viewing of the video clips available on the accompanying CD-ROM, should instead stimulate a substantive, civil, professional discourse about the nature and qualities of effective mathematics teaching. These findings and images can be a resource to direct attention away from superficial features of instruction and toward a focus on the extent to which different teaching methods can succeed in stimulating serious intellectual engagement on the part of students in a mathematics classroom.

Researchers, in particular, will find much to gain from the report’s descriptions of the video survey methodology and the video analysis scheme (which are described more completely in a forthcoming technical report [Jacobs et al. forthcoming]). The report offers a cogent argument for the use of video surveys as a method of analyzing teaching within a country and comparing teaching across countries.

back to top


The foregoing should make it clear that Teaching Mathematics in Seven Countries is an indispensable resource for educators, researchers, and policymakers. Yet even the large, exceedingly complex study on which the report is based has some limitations worth noting because they suggest important types of additional information that the study does not provide.

One limitation worth noting is that the study focuses on “typical” instructional practice rather than “best practice.” Knowing what teachers are willing and able to display when their typical practice is captured does not reveal what they might be able to do under optimal conditions.

A second limitation is the analytic focus on commonality rather than variation. One major outcome of the video analysis was the development of a lesson signature—a characteristic pattern of instructional features that characterized teaching in a country. To arrive at a lesson signature, the study authors examined typical instructional activities over time across the lessons observed in each country to discern patterns of regularity. As valuable as this analysis may be, it does not attend to patterns of variation across teachers that might be equally interesting and potentially more important.

A third limitation that bears noting is the unit of analysis in the study. The decision to analyze individual lessons rather than coherent sequences of lessons allowed the inclusion of a large number of teachers in the sample, yet it also limited the generalizability of the study’s conclusions. Although some variation in student achievement is likely due to factors at the lesson level, it is likely that many other important factors are evident only if one considers larger units of analysis, such as sequences of related lessons or coherent instructional units.

back to top


Teaching Mathematics in Seven Countries: Results From the TIMSS 1999 Video Study is an essential resource for those interested in analyzing, understanding, or improving the teaching of mathematics. By illuminating critical features of mathematics teaching around the world, the findings and methods presented in this report, along with the images of teaching provided on the accompanying CD-ROM, should enrich the work of scholars and practitioners alike.

back to top


Footnotes

* Hong Kong is a Special Administrative Region (SAR) of the People’s Republic of China.


Beaton, A.E., Mullis, I.V.S., Martin, M.O., Gonzalez, E.J., Kelly, D.L., and Smith, T.A. (1996). Mathematics Achievement in the Middle School Years: IEA’s Third International Mathematics and Science Study. Chestnut Hill, MA: Boston College.

Braswell, J.S., Lutkus, A.D., Grigg, W.S., Santapau, S.L., Tay-Lim, B.S.-H., and Johnson, M.S. (2001). The Nation’s Report Card: Mathematics 2000 (NCES 2001–517). U.S. Department of Education. Washington, DC: National Center for Education Statistics.

Educational Testing Service. (2002). A National Priority: Americans Speak on Teacher Quality. Princeton, NJ: Author. Available: http://www.ets.org/aboutets/survey2002.html [June 5, 2003].

Grouws, D.A., and Smith, M.S. (2000). NAEP Findings on the Preparation and Practices of Mathematics Teachers. In E.A. Silver and P.A. Kenney (Eds.), Results From the Seventh Mathematics Assessment of the National Assessment of Educational Progress (pp. 107–139). Reston, VA: National Council of Teachers of Mathematics.

Henningsen, M., and Stein, M.K. (1997). Mathematical Tasks and Student Cognition: Classroom-Based Factors That Support and Inhibit High-Level Mathematical Thinking and Reasoning. Journal for Research in Mathematics Education, 28: 524–549.

Jacobs, J., Garnier, H., Gallimore, R., Hollingsworth, H., Givvin, K.B., Rust, K., Kawanaka, T., Smith, M., Wearne, D., Manaster, A., Etterbeek, W., Hiebert, J., and Stigler, J.W. (forthcoming). TIMSS 1999 Video Study Technical Report: Volume 1: Mathematics Study (NCES 2003–012). U.S. Department of Education. Washington, DC: National Center for Education Statistics.

Mullis, I.V.S., Martin, M.O., Gonzalez, E.J., Gregory, K.D., Garden, R.A., O’Connor, K.M., Chrostowski, S.J., and Smith, T.A. (2000). TIMSS 1999 International Mathematics Report: Findings From IEA’s Repeat of the Third International Mathematics and Science Study at the Eighth Grade. Chestnut Hill, MA: Boston College.

National Commission on Teaching and America’s Future. (1996). What Matters Most: Teaching for America’s Future. New York: Author.

Schmidt, W.H., McKnight, C.C., Cogan, L.S., Jakwerth, P.M., and Houang, R.T. (1999). Facing the Consequences: Using TIMSS for a Closer Look at U.S. Mathematics and Science Education. Dordrecht: Kluwer.

Stake, R.E., and Easley, J. (Eds.). (1978). Case Studies in Science Education. Urbana, IL: University of Illinois.

Stein, M.K., Grover, B.W., and Henningsen, M. (1996). Building Student Capacity for Mathematical Thinking and Reasoning: An Analysis of Mathematical Tasks Used in Reform Classrooms. American Educational Research Journal, 33: 455–488.

Stein, M.K., and Lane, S. (1996). Instructional Tasks and the Development of Student Capacity to Think and Reason: An Analysis of the Relationship Between Teaching and Learning in a Reform Mathematics Project. Educational Research and Evaluation, 2 (1): 50–80.

Stein, M.K., Smith, M.S., Henningsen, M., and Silver, E.A. (2000). Implementing Standards-Based Mathematics Instruction. New York: Teachers College Press.

Stigler, J.W., Gonzales, P., Kawanka, T., Knoll, S., and Serrano, A. (1999). The TIMSS Videotape Classroom Study: Methods and Findings From an Exploratory Research Project on Eighth-Grade Mathematics Instruction in Germany, Japan, and the United States (NCES 99–074). U.S. Department of Education. Washington, DC: National Center for Education Statistics.

Stigler, J.W., and Hiebert, J. (1999). The Teaching Gap. New York: The Free Press.

U.S. Department of Education. (2000). Before It’s Too Late. A Report to the Nation From the National Commission on Mathematics and Science Teaching for the 21st Century. Washington, DC: U.S. Government Printing Office.

Weiss, I.R., Banilower, E.R., McMahon, K.C., and Smith, P.S. (2001). Report of the 2000 National Survey of Science and Mathematics Education. Chapel Hill, NC: Horizon Research, Inc.

back to top


Would you like to help us improve our products and website by taking a short survey?

YES, I would like to take the survey

or

No Thanks

The survey consists of a few short questions and takes less than one minute to complete.
National Center for Education Statistics - http://nces.ed.gov
U.S. Department of Education