Valena W. Plisko
Associate Commissioner of the National Center for Education Statistics
The Release of the National Assessment of Educational Progress (NAEP) The Nation's Report Card Trial Urban District Assessment, Reading 2002 and Writing 2002
July 22, 2003
Today the National Center for Education Statistics is releasing findings from the National Assessment of Educational Progress 2002 Trial Urban District Assessment for both reading and writing. Fourth- and eighth-grade public school students in five large urban school districts-New York City Public Schools, Los Angeles Unified, Chicago School District 299, Houston Independent School District, and Atlanta City-participated in the assessment. In addition, the report includes scores for public school students in the District of Columbia, which has frequently participated in NAEP state assessments.
2002 Trial Urban District Assessment Map: Students participating in the Trial Urban District Assessments were assessed as part of the 2002 Reading and Writing Assessments. National and state results for these assessments were released earlier this summer. This map shows the location of the urban school districts for both assessments in 2002 and helps to put the results in context by showing the demographic composition of the fourth-grade student population in each district.
The New York City Public School population is close to 40 percent Hispanic, over 30 percent Black, and about 15 percent White. In the Washington, DC school district the fourth-grade student population is predominately Black. The fourth-grade student population in the Atlanta City School District is also predominately Black. The Houston Independent School district has large Hispanic and Black student populations. Chicago School District 299 also has large Hispanic and Black populations. And, in the Los Angeles Unified school district, the fourth-grade population is 72 percent Hispanic.
The districts range in size from the Atlanta City school district, the 36th largest school district in the country with close to 60,000 students, to New York City Public Schools, the country's largest, with over one million.
Demographic Profile of Participating Districts, Grade 4 and 8 Public Schools: The average percentage of fourth- and eighth-grade minority students in the six urban districts can be compared to the national public school population and to the public school population for "central city" areas across the nation. These central city areas are defined by the Office of Management and Budget, and implemented by the Census Bureau. Central city areas include the nation's largest cities; they also include much smaller cities-like Lawton Oklahoma and Parkersburg, West Virginia. Thus, not all central cities are what are typically referred to as inner cities. The percentages of fourth and eighth grade students in each district from low-income families, as measured by eligibility for free or reduced price lunch can also be compared to the national public school population and to the public school population for "central city" areas across the nation.
The six urban districts have a higher percentage of minority students than either the nation or central cities. The same pattern is evident in the data for low-income students.
Note that data are not reported for New York at the eighth grade due to a low response rate. In addition, low-income data were not available for eighth graders in Los Angeles.
All NAEP assessments are based on samples. With samples, there is a margin of error associated with each score. When comparisons are drawn between scores, or between the percentages of students at the various achievement levels, the differences must be tested to determine if they are larger than the margin of error involved (i.e., differences that are statistically significant.) On the PowerPoint slides that accompany this document, these differences are marked in the tables by asterisks and in the figures by up and down arrows.
Features of the Reading Assessment: The students who took the NAEP Reading Assessment read completed texts appropriate to their grade. The texts reflected the purposes of reading: Reading for literary experience, reading to gain information, and reading to perform a task. Both fourth- and eighth-graders were assessed on the first two purposes. Only eighth-graders were assessed on reading to perform a task. All students responded to a combination of multiple-choice and written-answer questions.
NAEP reading scores for both the fourth- and eighth-grades are presented on a single 0 to 500 point scale. Results are also reported according to three reading achievement levels established by the National Assessment Governing Board. These levels are intended to describe standards for what students should know and be able to do. The three achievement levels are defined as Basic, Proficient, and Advanced. Basic represents partial mastery of prerequisite knowledge and skills that are fundamental for proficient work at each grade. Proficient represents solid academic performance, and Advanced represents superior performance. NAGB believes that all students should be performing at or above the Proficient level.
Average Reading Scores, Grade 4 Public Schools: This table displays the grade four average reading scores for the participating urban districts, along with the national and central city averages. All six districts are below the national average. Only New York and Houston are comparable to the central city average.
Comparisons of Average Reading Scores, Grade 4 Public Schools, by Urban District: This figure allows comparisons across districts. For example, the "New York City" row indicates that New York's average was lower than the national average, but higher than Atlanta, Chicago, Los Angeles, and the District of Columbia.
Reading Achievement Level Percentages, Grade 4 Public Schools: This table shows the percentage of students scoring at or above Basic and at or above Proficient for the six districts. Once again, New York and Houston have numbers that are not significantly different from the central city figure, while the other four districts are well below it.
Average Reading Scores, by Race/Ethnicity, Grade 4 Public Schools: This table gives average reading scores according to race/ethnicity. White students in Atlanta and the District of Columbia scored higher than White students in the nation and in central cities. Similarly, Asian Pacific Islander students in New York City outperformed their peers in central cities across the nation. In contrast, Black students in Chicago, the District of Columbia, and Los Angeles did not score as well as Black students in the nation as a whole or as Black students in central cities across the nation. The same is true when the scores of Hispanic students in Chicago and Los Angeles are compared to those of Hispanic students in the Nation. Despite these differences much of the variation in the overall scores is due to the difference in the makeup of the student populations. Scores for Asian/Pacific Islanders are omitted in four districts, because only Los Angeles and New York City had populations large enough to provide meaningful data.
Average Reading Scores, Grade 8 Public Schools: This table gives average reading scores for eighth-graders, as well as the national and central city averages.
Comparisons of Average Reading Scores, Grade 8 Public Schools: All five districts have average scores that are below both the national and central city average. Reading across for Chicago, as an example, it has scores that are higher than the District of Columbia, Los Angeles, and Atlanta.
Reading Achievement Level Percentage, Grade 8 Public Schools: The percentage of eighth-graders in Chicago who scored at or above Basic in reading was comparable to the central city percentage. Otherwise, all districts were below both the national and central city averages for students scoring at or above Basic and at or above Proficient.
Average Reading Scores, by Race/Ethnicity, Grade 8 Public Schools: This table displays average reading scores according to race/ethnicity for eighth-graders. White students in Houston scored above their peers in the nation and in central city schools. In contrast, Black students in Atlanta, the District of Columbia and Los Angeles and Hispanic students in Los Angeles had lower average scores than their peers in the nation and in central city schools; and White students in Los Angeles had a lower average score than their peers in the nation.
Features of the Writing Assessment: The NAEP Writing Assessment identifies three purposes for writing-informative, narrative, and persuasive-and asks students to write essays, narratives, and letters on the basis of writing tasks appropriate to their grade. For example, as a narrative writing task, eighth-graders were asked to respond to a picture showing a season of the year and write a letter to a grandparent relaying an interesting personal experience about the season. Other, more detailed examples are included in the report, along with examples of how students responded. To encourage students to edit their work, each student received a brochure on "How to Plan for Writing." Students were given space to plan and revise their writing. Trained raters scored student-writing responses according to a 6-level scoring guide, with scores ranging from excellent to unsatisfactory.
Unlike the NAEP Reading Assessment, the NAEP Writing Assessment reports scores for fourth- and eighth-grade students on separate scales for each grade, which range from 0 to 300. It also reports student writing performance according to the NAGB writing achievement levels, which, like the reading achievement levels, set standards for Basic, Proficient, and Advanced student performance.
Average Writing Scores, Grade 4 Public Schools: This table shows the average writing scores for the six districts, as well as the national average and the central city average.
Comparisons of Average Writing Scores, Grade 4 Public Schools: All districts except New York City and Houston were lower than the national and central city averages. And students in New York City scored higher than their peers in central city schools across the nation.
Writing Achievement Level Percentages, Grade 4 Public Schools: This table shows the percentage of students scoring at or above Basic and at or above Proficient for the six districts. For both measures, the percentages for New York and Houston do not show a difference when compared to either the national or central city average. All other districts had percentages that were lower than the national figures.
Average Writing Scores, by Free/Reduced-Price School Lunch Eligibility, Grade 4 Public Schools: This table shows the scores for low-income students (those eligible for free and reduced price lunch). In New York City, these students had an average score that was higher than the central city average, while the average for low-income students in the District of Columbia and Chicago was below both the national and central city averages.
Average Writing Scores, Grade 8 Public Schools: This table shows the average writing scores for the five districts, as well as the national average and the central city average.
Comparisons of Average Writing Scores, Grade 8 Public Schools: At the eighth-grade, all five districts had a lower average score than the national average and only Houston did not have an average score that was lower than the central city average.
Writing Achievement Level Percentages for Grade 8 Public Schools: This table shows the percentages of students who scored at or above Basic and at or above Proficient. For both categories, the percentages for all five districts were below the national percentages, and all except Houston were also below the central city percentages.
Average Writing Scores, by Free/Reduced-Price School Lunch Eligibility, Grade 8 Public Schools: This table shows the average scores for low-income students (those eligible for free- or reduced-price school lunch). In Atlanta, Chicago, the District of Columbia, and Houston these students had average scores that were lower than the national averages. The average scores for these students in Atlanta and the District of Columbia were also lower than the average score for low-income students in central city schools across the nation.
2003 Urban District Assessment Map: In the fall, NCES will release results from the 2003 NAEP Reading and Mathematics Urban District Assessments, which will give an expanded sample, adding Boston, San Diego, Cleveland, and Charlotte, as shown on this map.
Conclusion: Urban school districts serve millions of the most disadvantaged students in America. If the educational opportunities are to be improved for these students, it is particularly important to have performance data that allow comparisons both from one district to another and to the nation as a whole.
The authors of the 2002 TUDA Reading and Writing Assessment are Tony Lutkus, Arlene Weiner, Mary Daane, and Ying Jin at the Educational Testing Service. Peggy Carr, NCES Associate Commissioner for Assessment, Andrew Kolstad, Senior Technical Advisor for Assessment, and Arnold Goldstein and Taslima Rahman, who served as the NAEP Project Officers responsible for these reports, provided overall direction. Many other individuals at NCES, ETS, and other NCES staff and contractors contributed as well.
NCES wishes to thank the school districts that agreed to participate in this trial assessment. They are taking the lead in a study that will produce valuable new data to support efforts for educational improvement in our nation's urban areas. NCES also wishes to thank the students who participated in this assessment, their teachers, and their schools.
Complete results for The Nation's Report Card: Trial Urban District Assessment, Reading 2002 and Writing 2002 are available on the web through the NAEP Home page at: http://nces.ed.gov/nationsreportcard/.
Download, view, and print the slides for the Associate Commissioner's presentation as a zipped PowerPoint file (729 KB).
A statement by Education Secretary Paige on the NAEP 2002 Trial Urban District Assessment for Reading and Writing is also available.