The ECLS-K:2011 child assessments include items that are adapted from several copyrighted assessment batteries; assessment batteries are not posted here due to copyright restrictions. However, a detailed description of the child assessments is available in the ECLS-K:2011 User's Manuals and Psychometric Reports (forthcoming). Summary information on the child assessments is available below.
The ECLS-K:2011 assessed children's development through direct and indirect methods. The direct child assessments are cognitive assessment batteries administered directly to children; items measuring social, behavioral, and emotional development; and measures of physical development. The indirect child assessments are parent and teacher ratings of children's development.
Direct Cognitive Assessments:
The direct cognitive assessments were designed to measure children's knowledge and skills at given time points, as well as track their academic growth in different subject areas across time. Results from the assessments for reading, mathematics, and executive function (working memory and cognitive flexibility) enable researchers to measure growth from the fall of children's kindergarten year (fall 2010) through the spring of 2016, when most ECLS-K:2011 students were in the fifth grade. Science knowledge and skills can be examined beginning in the spring of children's kindergarten year.
The ECLS-K:2011 assessed knowledge and skills that are typically taught and developmentally important. The assessment frameworks were derived from national and state standards, including those of the National Assessment of Educational Progress (NAEP), the ECLS-K frameworks, and selected states' curriculum standards. The ECLS-K:2011 assessments include items that were specifically created for the ECLS studies, items adapted from commercial assessments with copyright permission, and items from other NCES studies.
In the kindergarten and first-grade rounds, the components of the ECLS-K:2011 assessment administered to children who spoke a language other than English at home depended on the children's performance on a language screener, which was administered as the first component of the assessment. The screener consisted of two tasks from the Preschool Language Assessment Scale (preLAS 2000). The "Simon Says" task required children to follow simple, direct instructions given by the assessor in English. The "Art Show" task was a picture vocabulary assessment that tested children's expressive vocabulary. All children, regardless of home language, were administered the language screener as the first component of the direct cognitive assessment. For children whose home language was English, the screener primarily served as a warm-up or practice for the rest of the assessment since the items were of low difficulty. While the screener also served as a warm-up for children whose home language was one other than English, it also determined whether the children understood English well enough to receive the full direct child assessment in English. All children received the first set of items on the reading assessment in English, regardless of their home language or performance on the language screener. Once this first set of items was administered, the cognitive assessments in English ended for children whose home language was not English and who did not achieve at least a minimum score on the language screener. Spanish-speaking children who did not achieve at least the minimum score on the screener were then administered a short reading assessment in Spanish that measured Spanish early reading skills (SERS), as well as the mathematics and executive function assessments that had been translated into Spanish. Children whose home language was one other than English or Spanish and who did not achieve at least the minimum score on the screener were not administered any of the remaining cognitive assessments beyond the first set of reading items. All children had their height and weight measured. Beginning in second grade, all study children were administered the entire assessment in English, regardless of home language.
The ECLS-K:2011 direct cognitive assessments in reading, mathematics, and science were individually administered, two-stage adaptive tests (with the exception of the spring kindergarten science assessment, which was a relatively short assessment comprising one set of items administered to all children). Assessors asked the children questions related to images (such as pictures, letters of the alphabet, words, or short sentences for reading or numbers and number problems for mathematics) that were presented on a small easel. Children responded by pointing or telling the assessor their answers. They were not required to write their answers or explain their reasoning.
For each two-stage assessment, the first stage is a routing section that includes items covering a broad range of difficulty. A child's performance on the routing section determined which one of three second-stage tests (low, middle, or high difficulty) the child was administered. The second-stage tests vary by level of difficulty so that a child was administered questions appropriate to his or her demonstrated level of ability for each of these cognitive domains. The purpose of this adaptive assessment design is to maximize accuracy of measurement and minimize both administration time and the potential for floor and ceiling effects.
The second-stage forms include some items that overlap (e.g., some items in the low-level form also are included in the middle-level form). The common routing test and the item overlap between second-stage forms help to ensure that there is a sufficient number of items to precisely measure the child's skills.
Reading:The reading assessment includes questions measuring basic skills such as print familiarity, letter recognition, beginning and ending sounds, recognition of common words (sight vocabulary), and decoding multisyllabic words; vocabulary knowledge such as receptive vocabulary and vocabulary-in-context; and reading comprehension. Reading comprehension questions asked the child to identify information specifically stated in text (e.g., definitions, facts, supporting details), make complex inferences within and across texts, and consider the text objectively and judge its appropriateness and quality. The selected reading passages represent a variety of literary genres such as poetry, letters, fiction, and nonfiction, with the content, length, and language complexity appropriate for the grade level being assessed. Assessments in the earlier grades begin with relatively more emphasis on basic reading skills, while greater emphasis is placed on comprehension in the assessments for the later grades. As noted above, in the kindergarten and first-grade rounds, all children received the first set of items on the reading assessment in English, regardless of their home language or performance on the language screener. These items, plus two items from the preLAS "Art Show" task (a total of 20 items), make up the section of the reading assessment referred to as the English basic reading skills (EBRS) section because they measure such skills.
The mathematics assessment includes questions measuring conceptual knowledge, procedural knowledge, and problem solving. The assessment includes questions on number sense, properties, and operations; measurement; geometry and spatial sense; data analysis, statistics, and probability; and patterns, algebra, and functions.
The science assessment includes questions about physical sciences, life sciences, environmental sciences, and scientific inquiry. For the spring kindergarten science assessment, the assessment was composed of 20 items that all children who were administered the science assessment received; a two-stage assessment was not used for this domain until the fall first-grade round.
The executive function component of the cognitive assessment obtained information on important cognitive processes associated with learning: cognitive flexibility and working memory. To assess children's cognitive flexibility, the Dimensional Change Card Sort (DCCS; Zelazo 2006) was used. The DCCS was administered as a physical card sort in kindergarten and first grade and as an electronic card sort, which allows for the capture of response time, beginning in second grade. To assess working memory, children completed the Numbers Reversed subtest of the Woodcock-Johnson III Tests of Cognitive Abilities (Mather and Woodcock 2001).
Indirect Cognitive Assessments:
The Academic Rating Scale was developed for the ECLS-K to obtain teachers' evaluations of children's academic achievement in three domains: language and literacy, science, and mathematical thinking. The Academic Rating Scale developed for the ECLS-K was included in the kindergarten and first-grade rounds of the ECLS-K:2011, with some modifications to the item text. The Academic Rating Scale was designed both to overlap and to augment the information gathered through the direct cognitive assessment battery. Although the direct and indirect instruments measure children's skills and behaviors within the same broad curricular domains with some intended overlap, several of the constructs they were designed to measure differ in significant ways. Most importantly, the Academic Rating Scale includes items designed to measure both the process and products of children's learning in school, whereas the direct cognitive battery is more limited. Because of time and space limitations, the direct cognitive assessment battery is less able to measure the process of children's thinking, including the strategies they use to read, solve mathematical problems, or investigate a scientific phenomenon.
Behavioral, Social, and Emotional Development Measures:
The ECLS-K:2011 behavioral, social, and emotional development assessments focus on aspects of social competence, including social skills (e.g., social interaction, attentional focus, and self-control) and problem behaviors (e.g., impulsivity and externalizing problem behaviors). Both the child-level teacher questionnaires and parent interviews also included "Approaches to Learning" items that asked the teachers and parents to report how often the ECLS-K:2011 children exhibited a selected set of learning behaviors (keeps belongings organized; shows eagerness to learn new things; works independently; easily adapts to changes in routine; persists in completing tasks; pays attention well; and follows classroom rules). Teachers also reported on closeness and conflict between them and the study children. Parents and teachers were the primary sources of information on children's social competence and skills in kindergarten, first grade, and second grade.
In the third, fourth, and fifth grades, ECLS-K:2011 students completed a self-administered questionnaire themselves. Topics on the child questionnaire included interest and perceived competence in reading, math, and science; relationships with peers; social distress; occurrences of peer victimization; and life satisfaction and prosocial behavior.
Children's height and weight were measured at each round of data collection. Additionally, in the fall of second grade, spring of third grade, and spring of fifth grade a subsample of children had their hearing evaluated.
The assessments can be reviewed by approved researchers at NCES's Washington, DC office. Researchers interested in using ECLS-K:2011 assessments in their own research must obtain permission from both NCES and the publishers of the assessment items. For information regarding scheduling a review of the assessments or applying for permission to administer the ECLS-K:2011 assessments in your own research, please contact ECLS staff via email at ECLS@ed.gov or send your inquiry to:
Early Childhood Longitudinal Study
Attention: Jill McCarroll, Room 4001
National Center for Education Statistics
550 12th Street SW
Washington DC 20202
Item-level ECLS-K:2011 cognitive assessment data are not currently available.