In 1992, the Arts Education Consensus Project, sponsored by the National Assessment Governing Board (NAGB), began an 18-month effort to establish objectives for assessing arts instruction in the nation's elementary and secondary schools. The National Assessment of Educational Progress (NAEP) had assessed the visual arts in 1975 and 19781 . The National Endowment for the Arts, in collaboration with the Getty Center for Education in the Arts, funded the Arts Education Consensus Project, designed to develop the NAEP Arts Education Assessment Framework.
The Consensus Project2 identified objectives for arts education in general and individually for dance, music, theatre, and the visual arts, in the fourth, eighth, and twelfth grades. It also developed Assessment Specifications for each of the four arts, setting forth requirements for the content of the assessments in more detail. NAEP field-tested the visual arts assessment for the fourth and eighth grades in 1995 and for the twelfth grade in 1997. In the spring of 1999, NAEP will publish a Field Test Process Report, on the development, administration, and scoring of arts tasks for the three grades. The report will cover all four arts, including the visual arts.
In 1997, NAEP conducted an assessment of eighth-grade students' achievement in the arts. NAEP assessed eighth-grade students in music and the visual arts using a nationally representative sample of all students, regardless of their background in music or the visual arts. The sample for the visual arts assessment, approximately 2,500 students, in both public and private schools, was large enough to obtain statistically valid results. The theatre assessment was a targeted assessment, limited to students who would have completed at least 30 class hours in theatre instruction by the end of the 1996-97 school year. Because there were too few dance programs in schools to allow for an adequate national sample, NAEP did not conduct an assessment in dance. Results of the three assessments, together with samples of arts tasks for all four arts, will appear in the NAEP 1997 Arts Report Card, which will be published in the fall of 1998.
The next two sections of this Focus on NAEP summarize the current visual arts framework, which is set forth in full in the NAEP 1997 Arts Education Assessment Framework. Following these sections will be a discussion of the visual arts field tests.
The visual arts are rightly described in the plural: at their broadest, they take in such forms as painting, drawing, printmaking, and sculpture. They also embrace more recent media (photography, film, video, and computer imaging), and functional design areas such as architecture and industrial and graphic design. The visual arts enable students to reflect on what they inherit from past and present world cultures.
The expectation of the framework as a whole and for the visual arts in particular is not that all students will become professional artists, although some will. What is expected is that they will have experienced enough of the discipline, the challenge, and the joy of creating in different art forms to understand intimately the human significance of all the arts, not simply the visual arts (see table 1 for assessment guidelines).
Skills in the visual arts relate to understanding how to construct or interpret meaning in visual form. Creating skills include gathering information; analyzing and synthesizing experience; generating many visual ideas or solutions; selecting among competing ideas, media, or processes; planning and organizing the visual execution of ideas; evaluating ideas and form; and applying technical proficiency in the making of visual objects. Responding includes many of the above skills applied in interpretive contexts. Verbal skills exhibited in oral and written presentations and the construction of convincing arguments are also relevant.
Responding in the visual arts means interpreting works of art or design done by artists/designers or the students themselves. Responding is an interpretive and evaluative behavior that reveals knowledge of how visual form communicates meaning in various contexts. It includes the ability to articulate as well as formulate judgments.
The writers of the framework sought to be as inclusive as possible both in terms of the kinds of art students would be asked to analyze, and in terms of the kinds of production tasks students would be given. The Consensus Project's Assessment Specifications require coverage of art dating from before the 13th century to the present, from a wide range of geographic areas, including Africa, Asia, Europe, and South America (see table 3).
The framework envisioned that students would have the opportunity to show what they know and can do vis--vis the visual arts by both analyzing and creating works of art and design. Students would engage in a range of processes that would capture the complexity of analyzing and creating.
The performance task assessed creating, while the paper-and-pencil tasks assessed students' abilities to respond to the visual arts. To ensure coverage of all aspects of knowledge of the visual arts, and to lighten the burden on a given student, NAEP developed a number of different "blocks," for both the paper-and-pencil and the performance tasks. Students in the sample were assigned at random to several paper-and-pencil blocks and one performance block. While the NAEP 1997 Visual Arts Assessment went further in covering the full range of the visual arts than previous assessments, due to constraints of time and expense it was not possible to assess student performance in such areas as film and video.
NAEP performance tasks are designed to be as authentic as time and resources permit. However, the assessment tasks must also offer the same opportunities and the same challenges, in the same circumstances, for all students assessed. No comparison across students is possible without such standardization. In 1998, NAEP will make all tasks not subject to copyright, both paper-and-pencil and performance, for all three grades, available to the public.
The paper-and-pencil tasks went well beyond traditional "art appreciation" questions. One task asked students to consider several sculptures, intended for use in a public space, and to select the one most appropriate for an imaginary community, explaining their reasons for doing so, based on such considerations as the makeup of the community and the purpose of the statue. Students were also asked to consider design issues involved in basic household utensils.
Creating and administering a national assessment was very challenging. The NAEP Visual Arts Framework, Field Test, and Assessment provide useful models for future assessments, at the state and local level, as well as nationally. Several important problems were confronted during the development and scoring of the assessment. Among these were how to create tasks suitable for a variety of students with a variety of educational backgrounds, while also making distinctions among levels of student ability. These issues, among others, will be explored in the upcoming arts reports.
Design and Drawing Skills. Selected Results from the First National Assessment of Art, June 1977. , Washington, DC. ERIC # ED141249.
Knowledge About Art. Selected Results from the First National Assessment of Art. Education Commission of the States, Denver, CO. ERIC # ED155116.
Attitudes Toward Art. Selected Results from the First National Assessment of Art. Education Commission of the States, Denver, CO. ERIC # ED166122.
For results from the second assessment of the visual arts, see Art and Young Americans, 1974-1979: Results from the Second National Art Assessment. ; National Institute of Education, Washington, DC. ERIC # ED212538.
2. For details on the Arts Education Consensus Project, see the Arts Education Assessment Framework for the 1997 National Assessment of Educational Progress (1994), the National Assessment Governing Board.
North Capitol Street, NW, Suite 825, Washington, DC 20002-4233. Copies may also be obtained on the World Wide Web at http://www.nagb.org/.
National Standards for Arts Education. Copies are available for $20 from the Music Educators National Conference, 1806 Robert Fulton Drive, Reston VA 20191, 800-336-3768.
Arts Education in Public Elementary and Secondary Schools, NCES 95-082, provides data obtained from questionnaires sent to the principals of nationally representative samples of public schools. It is not in print, but is available over the NAEP web site at /nationsreportcard/.
The following Focus on NAEP publications are also available free from the , U.S. Department of Education, Washington, DC 20208-5653. Copies may also be accessed over the World Wide Web at /nationsreportcard/.
The NAEP Arts Education Framework, Field Test, and Assessment, NCES 98-527
NAEP and Dance: Framework, Field Test, and Survey, NCES 98-459
NAEP and Music: Framework, Field Test, and Assessment, NCES 98-529
NAEP and Theatre: Framework, Field Test, and Assessment, NCES 98-528
The Focus on NAEP series briefly summarizes information on the ongoing development and implementation of the National Assessment of Educational Progress (NAEP). The series is a product of the (NCES), Pascal D. Forgione, Jr., Commissioner, and Gary W. Phillips, Associate Commissioner for Education Assessment. This Focus on NAEP was written by Alan Vanneman, of the Education Statistics Services Institute and Mac Arthur Goodwin of the South Carolina State Department of Education.
Information on NAEP may also be obtained over the World Wide Web at /nationsreportcard/.
Download/view the full report in a PDF file. (58K)