The ECLS-K:2011 child assessments include items that are adapted from several copyrighted assessment batteries; assessment batteries are not posted here due to copyright restrictions. However, a detailed description of the child assessments is available in the ECLS-K:2011 User's Manuals and Psychometric Reports (forthcoming). Summary information on the child assessments is available below.
The ECLS-K:2011 assesses children's cognitive, socioemotional, and physical development through direct and indirect methods. The direct child assessments are cognitive and socioemotional assessment batteries developed specifically for use in the ECLS-K:2011 and administered directly to the children. Physical development also is measured directly. The indirect child assessments are parent and teacher ratings of children's cognitive and socioemotional development.
Direct Cognitive Assessments:
The direct cognitive assessments are designed to measure children's knowledge and skills at given time points, as well as track their academic growth in different subject areas across time. The assessments for reading, mathematics, and executive function (working memory and cognitive flexibility) will enable researchers to measure growth from the fall of children's kindergarten year (fall 2010) through the spring of 2016, when most ECLS-K:2011 students will be in the fifth grade. Science knowledge and skills can be examined beginning in the spring of children's kindergarten year.
The ECLS-K:2011 assesses knowledge and skills that are typically taught and developmentally important. The assessment frameworks were derived from national and state standards, including those of the National Assessment of Educational Progress (NAEP), the ECLS-K frameworks, and selected states' curriculum standards. The ECLS-K:2011 assessments include items that were specifically created for the ECLS studies, items adapted from commercial assessments with copyright permission, and items from other NCES studies.
In the kindergarten and first-grade rounds, the components of the ECLS-K:2011 assessment
administered to children who spoke a language other than English at home depended
on the children's performance on a language screener, which was administered
as the first component of the assessment. The screener consisted of two tasks from
the Preschool Language Assessment Scale (preLAS 2000). The "Simon
Says" task required children to follow simple, direct instructions given by
the assessor in English. The "Art Show" task was a picture vocabulary
assessment that tested children's expressive vocabulary. All children, regardless
of home language, were administered the language screener as the first component
of the direct cognitive assessment. For children whose home language was English,
the screener primarily served as a warm-up or practice for the rest of the assessment
since the items were of low difficulty. While the screener also served as a warm-up
for children whose home language was one other than English, it also determined
whether the children understood English well enough to receive the full direct child
assessment in English. All children received the first set of items on the reading
assessment in English, regardless of their home language or performance on the language
screener. Once this first set of items was administered, the cognitive assessments
in English ended for children whose home language was not English and who did not
achieve at least a minimum score on the language screener. Spanish-speaking children
who did not achieve at least the minimum score on the screener were then administered
a short reading assessment in Spanish that measured Spanish early reading skills
(SERS), as well as the mathematics and executive function assessments that had been
translated into Spanish. Children whose home language was one other than English
or Spanish and who did not achieve at least the minimum score on the screener were
not administered any of the remaining cognitive assessments beyond the first of
reading items. All children had their height and weight measured. Beginning in second
grade, all study children are administered the entire assessment in English, regardless
of home language.
The ECLS-K:2011 direct cognitive assessments in reading, mathematics, and science are individually administered, two-stage adaptive tests (with the exception of the spring kindergarten science assessment, which was a relatively short assessment comprising one set of items administered to all children). Assessors ask the children questions related to images (such as pictures, letters of the alphabet, words, or short sentences for reading or numbers and number problems for mathematics) that are presented on a small easel. Children respond by pointing or telling the assessor their answers. They are not required to write their answers or explain their reasoning.
For each two-stage assessment, the first stage is a routing section that includes items covering a broad range of difficulty. A child's performance on the routing section determines which one of three second-stage tests (low, middle, or high difficulty) the child is administered. The second-stage tests vary by level of difficulty so that a child is administered questions appropriate to his or her demonstrated level of ability for each of these cognitive domains. The purpose of this adaptive assessment design is to maximize accuracy of measurement and minimize both administration time and the potential for floor and ceiling effects.
The second-stage forms include some items that overlap (e.g., some items in the low-level form also are included in the middle-level form). The common routing test and the item overlap between second-stage forms help to ensure that there is a sufficient number of items to precisely measure the child's skills.
The reading assessment includes questions measuring basic skills such as print familiarity, letter recognition, beginning and ending sounds, recognition of common words (sight vocabulary), and decoding multisyllabic words; vocabulary knowledge such as receptive vocabulary and vocabulary-in-context; and reading comprehension. Reading comprehension questions asked the child to identify information specifically stated in text (e.g., definitions, facts, supporting details), make complex inferences within and across texts, and consider the text objectively and judge its appropriateness and quality. The selected reading passages represent a variety of literary genres such as poetry, letters, fiction, and nonfiction, with the content, length, and language complexity appropriate for the grade level being assessed. Assessments in the earlier grades begin with relatively more emphasis on basic reading skills, while greater emphasis is placed on comprehension in the assessments for the later grades. As noted above, in the kindergarten and first-grade rounds, all children received the first set of items on the reading assessment in English, regardless of their home language or performance on the language screener. These items, plus two items from the preLAS "Art Show" task (a total of 20 items), make up the section of the reading assessment referred to as the English basic reading skills (EBRS) section because they measure such skills.
The mathematics assessment includes questions measuring conceptual knowledge, procedural knowledge, and problem solving. The assessment includes questions on number sense, properties, and operations; measurement; geometry and spatial sense; data analysis, statistics, and probability; and patterns, algebra, and functions.
The science domain was added to the cognitive assessment in the spring kindergarten data collection. This assessment domain includes questions about physical sciences, life sciences, environmental sciences, and scientific inquiry. For the spring kindergarten science assessment, the assessment was composed of 20 items that all children who were administered the science assessment received; a two-stage assessment was not used for this domain until the fall first-grade round.
The executive function component of the cognitive assessment obtains information on important cognitive processes associated with learning: cognitive flexibility and working memory. To assess children's cognitive flexibility, the Dimensional Change Card Sort (DCCS; Zelazo 2006) is used. The DCCS was administered as a physical card sort in kindergarten and first grade and as an electronic card sort, which allows for the capture of response time, beginning in second grade. To assess working memory, children complete the Numbers Reversed subtest of the Woodcock-Johnson III Tests of Cognitive Abilities (Mather and Woodcock 2001).
Indirect Cognitive Assessments:
The Academic Rating Scale was developed for the ECLS-K to obtain teachers' evaluations of children's academic achievement in three domains: language and literacy, science, and mathematical thinking. The Academic Rating Scale developed for the ECLS-K was included in the kindergarten and first-grade rounds of the ECLS-K:2011, with some modifications to the item text. The Academic Rating Scale was designed both to overlap and to augment the information gathered through the direct cognitive assessment battery. Although the direct and indirect instruments measure children's skills and behaviors within the same broad curricular domains with some intended overlap, several of the constructs they were designed to measure differ in significant ways. Most importantly, the Academic Rating Scale includes items designed to measure both the process and products of children's learning in school, whereas the direct cognitive battery is more limited. Because of time and space limitations, the direct cognitive assessment battery is less able to measure the process of children's thinking, including the strategies they use to read, solve mathematical problems, or investigate a scientific phenomenon.
The ECLS-K:2011 socioemotional development assessments focus on aspects of social competence, including social skills (e.g., social interaction, attentional focus, and self-control) and problem behaviors (e.g., impulsivity and externalizing problem behaviors). Both the child-level teacher questionnaires and parent interviews also include "Approaches to Learning" items that ask the teachers and parents to report how often the ECLS-K:2011 children exhibit a selected set of learning behaviors (keeps belongings organized; shows eagerness to learn new things; works independently; easily adapts to changes in routine; persists in completing tasks; pays attention well; and follows classroom rules). Teachers also report on closeness and conflict between them and the study children. Parents and teachers were the primary sources of information on children's social competence and skills in kindergarten, first grade, and second grade.
In the third, fourth, and fifth grades, ECLS-K:2011 students will complete a self-administered questionnaire themselves. Topics on the child questionnaire include interest and perceived competence in reading, math, and science; relationships with peers; social distress; occurrences of peer victimization; and life satisfaction and prosocial behavior.
Children's height and weight were measured at each round of data collection. Additionally, in the fall of second grade, a subsample of children had their hearing evaluated.
The assessments can be reviewed by approved researchers at NCES's Washington, DC office. Researchers interested in using ECLS-K:2011 assessments in their own research must obtain permission from both NCES and the publishers of the assessment items. For information regarding scheduling a review of the assessments or applying for permission to administer the ECLS-K:2011 assessments in your own research, please contact ECLS staff via email at ECLS@ed.gov or send your inquiry to:
Early Childhood Longitudinal Study
Attention: Jill McCarroll, Room 9033
National Center for Education Statistics
1990 K St NW
Washington DC 20006
Item-level ECLS-K:2011 cognitive assessment data are not currently available.