Inside IES Research

Notes from NCER & NCSER

Powering Our Future: How Service-Learning Aligned with Next Generation Science Standards Can Promote Science Learning, Social and Emotional Skills, and Civic Engagement

Each generation faces its own societal challenges. Two prominent issues—the climate crisis and America’s political divide—are heavy burdens for today’s youth. Without explicit focus in schools, it is hard to imagine how children will learn to work across differences and collaborate with others to solve complex environmental problems. Youth are very capable people, and school comes alive when they feel agency and see how their efforts matter in the community. Service-learning can help teachers make instruction feel relevant and teach skills that lead to civic engagement as youth learn to design, implement, and evaluate solutions to problems that are important to them. In this interview blog, the Connect Science project team explains how they developed curriculum and professional development to support teachers to engage their students in service-learning experiences.

Can you tell us about Connect Science and what it looks like in action?

Fueled by an IES Development and Innovation grant, our team developed and evaluated a science-based service-learning approach for the upper-elementary school years. In doing so, we answered a need that teachers and schools face as they strive to create engaging experiences aligned with the Next Generation Science Standards (NGSS).

Connect Science is a 12-week project-based learning unit for upper elementary students. Early on, teachers and students explore topics of energy and natural resources using lessons aligned with the NGSS. Teachers guide student learning on what it means to be an engaged citizen and on the social and collaborative skills needed to take action in the community. To prepare, teachers receive five days of professional development and follow-up coaching. Teachers also receive a Connect Science manual, related books, and science materials.

But what does Connect Science actually look like in action? Imagine fourth graders engaged in a science unit on renewable and non-renewable resources. The students learn about different energy sources and then discuss pros and cons of each source. They become aware that non-renewable energy resources are rapidly diminishing and would not always be available to generate electricity. The awareness of this problem energizes them to promote energy conservation. Toward that goal, the students decide to educate other students and families at their school about energy use. At the next open house night, they turn their cafeteria into an energy fair where they share important information. For example, one group of students teaches about what types of energy sources were used in their state to produce electricity and another group teaches ways that people can save energy in their home. Before and after the energy fair, the students administer a pre- and post-survey on energy facts to size up what their visitors learned.

How did the IES grant support the development and pilot testing of Connect Science?

In the first two years of this grant, we developed and tested materials with teachers. In the third year, we conducted a randomized controlled trial of Connect Science involving 41 classrooms with 20 in Connect Science and 21 in a waitlist comparison group, resulting in a student sample of 868 students (423 students participated in the intervention).

We found that Connect Science impacted teacher practices and student outcomes. Teachers in the Connect Science group were more effective at engaging in the two NGSS practices that we measured: eliciting and building on prior knowledge and creating opportunities for student critique, explanation, and argument. Further, we saw higher science achievement and energy attitudes and behaviors in the intervention than control condition. The social skill results hinged on the fidelity of implementation. When teachers used more Connect Science practices, students showed improved communication and social competence. As a result of these findings, Connect Science is designated as a Promising Program by the Collaborative for Academic, Social, and Emotional Learning (CASEL).

What are the implications of your findings?

Too few projects integrate academic and social learning in schools. Often, high-quality NGSS materials are developed with little thought about the social skills students need to engage in that instruction. Likewise, social and emotional learning is often taught separately from academic content. Service-learning is a framework that bridges these two areas and allows students to engage in authentic, science-based work. Given our experiences, we have a few recommendations for educators eager to use service-learning.

  • Teach social, emotional, and collaborative skills with intention before launching into group work. In the elementary schools, children thrive from being in supportive caring classrooms and they respond well to lessons on active listening, respectful communication, and understanding people with multiple perspectives.
  • Leverage the existing curriculum and build in service-learning experiences. Rather than adding one more new topic, look at existing curricular topics and use service-learning to facilitate deep learning on content areas that already part of the curriculum.
  • Amplify youth voice. Teachers need to work with students to identify a relevant community problem and generate solutions to that problem. We carefully developed the Connect Science materials to be more teacher-directed toward the beginning of the unit and more student-directed toward the end. This approach was based both on theoretical and empirical work supporting the importance of student autonomy.

 


Sara Rimm-Kaufman is the Commonwealth Professor of Education at the University of Virginia School of Education and Human Development. Her recent book for teachers, SEL from the Start, is based on the Connect Science work.

Eileen Merritt is a Research Scientist in the College of Natural Resources and the Environment at Virginia Tech. Her research and teaching focus on environmental and sustainability education.

Tracy Harkins is the owner of Harkins Consulting, LLC in Maine. Her focus is providing professional development and resources to engage and motivate student learners through service-learning. She will be offering an upcoming Connect Science Institute in Summer 2022.

For questions about this project, please contact Corinne.Alfeld@ed.gov, NCER program officer.

From Disproportionate Discipline to Thriving Students: An IES Postdoc’s Mission

This year, Inside IES Research is publishing a series of blogs showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. This week, Dr. Courtney Zulauf-McCurdy, an IES postdoctoral fellow at the University of Washington School Mental Health Assessment Research and Training (SMART) Center, shares her experiences and discusses her path forward.

 

My interests in child development began early on. I moved frequently for my parents’ work, so I was often seen as an outsider by the other children at the schools I attended. One school in particular had a group of “popular students” who bullied others and were particularly aggressive to peers. Often, teachers and parents would turn a blind eye to this behavior, and I became curious about how parents and educators respond to and shape child behavior.

Understanding Disparities in Early Childhood

I pursued a PhD in clinical psychology at the University of Illinois at Chicago out of a desire to advocate for children in both research and clinical practice. As a graduate student in the Social Emotional Teaching and Learning (SETL) Lab, I worked directly with parents, educators, and young children to understand how the school and home environment shape child behavior. Much of our research aimed to support teachers in improving children’s social-emotional development, but what I learned was that teachers weren’t providing equal opportunities and experiences to all children.

In particular, I became focused on an alarming disparity: disproportionate discipline. Not only are preschoolers being expelled at rates three times higher than students in K-12, but there are large discipline disparities by gender and race. In AY 2013-14, the U.S. Department of Education reported that Black children composed 19% of enrollment but 47% of those expelled. A report citing data from the 2016 U.S. Census Bureau found that children with social emotional difficulties are 14.5 times more likely to be expelled.

During graduate school, I explored the reasons why Black boys are being disproportionately expelled and found that it was at least in part related to teachers’ biased perceptions of parents. Because of this, I became interested in developing evidenced-based interventions for parents and educators to protect children from being expelled.

For my clinical internship, I specialized in integrated behavioral health at the Children’s Hospital of Philadelphia, where I provided evidenced-based practices to children and families in underserved community settings. Here, I learned about behavioral interventions that improve child behavior, which work best when parents and teachers work together across home and school. However, I noticed that children of color were less likely to receive evidenced-based interventions (such as classroom-based behavioral interventions or parent management training), and even when they do, parents and teachers experience barriers to working together to implement these interventions. As a result, I shifted my focus from designing new interventions to understanding how to improve the implementation of interventions in community settings that serve young children from under-represented backgrounds.

Moving from Intervention Development to Implementation Science

As a second year IES postdoctoral fellow at the University of Washington (UW) SMART Center, I am combining my research interests with implementation science. I am partnering with educators and parents to understand how teacher perceptions of parents and parent engagement is an implementation determinant—that is, a barrier or facilitator. Together, we are learning how to reduce disparities in preschool by improving the implementation of interventions that allow for early, easy, and acceptable access to families who face the highest levels of barriers. 

I have been using stakeholder-engaged processes consisting of focus groups, community advisory boards, and rapid try outs of strategies to ensure equity by engaging the perspectives of families from under-represented minority backgrounds. Such community engagement aims to ensure that our interventions are culturally responsive and unimpeded by bias.

Through my work, I have learned that educators and parents want the best outcomes for their children but face a multitude of barriers that hinder their ability to engage. For example, preschool teachers have limited resources, face stress and burnout, are under-prepared and underpaid, leading to considerable barriers in addressing the mental health needs of young children. Likewise, parents face obstacles such as perceived bias from their child’s school and logistical barriers such as time and childcare.

Moving Forward

I will continue working directly with parents and educators to understand how we can place all young children (and their families) in the best position to thrive. I will continue to use research methods, such as community advisory boards and qualitative methods, that seek to elevate the voices of parents and educators to promote equitable child outcomes. Through continued collaboration with community partners, disseminating my findings to parents, educators, and practitioners and connecting research with culturally responsive early childhood practice and policies, I hope to dismantle disparities in preschool outcomes.


Produced by Meredith Larson (Meredith.Larson@ed.gov), a program officer for IES Postdoctoral Training grants, and Bennett Lunn (Bennett.Lunn@ed.gov), Truman-Albright Fellow for the National Center for Education Research and the National Center for Special Education Research.

Integrating Social-Emotional and Literacy Learning in the Primary Grades

Teachers often have the critical and daunting task of developing behavioral and academic skills simultaneously. For students at risk for emotional and behavioral disorders (EBD), this can be even more challenging. Researchers Ann Daunic and Nancy Corbett, along with co-PI Stephen Smith and other colleagues at the University of Florida, developed Social-Emotional Learning Foundations (SELF), an intervention  developed and tested for efficacy through IES funding. SELF combines instructional strategies in literacy and social-emotional self-regulation for kindergarten and first grade teachers to provide more in-depth opportunities for at-risk students to develop these skills. Recently, we spoke with the SELF creators to learn more about the needs addressed by the intervention and the early evidence for its efficacy.

What are some challenges facing early elementary students at risk for developing EBD?

Photo of Ann Daunic
Ann Daunic (AD): Children at risk for developing EBD typically have issues with self-regulation, which can lead to a variety of maladaptive behaviors and affect their social-emotional adjustment and their academic outcomes. For example, children with aggressive tendencies are often impulsive, lack appropriate decision-making skills, and may be rejected by peers.

What are some challenges facing teachers of students at risk for EBD in the area of literacy?

Photo of Nancy Corbett

Nancy Corbett (NC): We know that higher levels of behavioral self-regulation are associated with greater literacy and language skills. Children who come to kindergarten with fewer skills, either social or cognitive, may experience the classroom as a threatening place and therefore be less engaged with school at an early age. When children are disengaged at school, important early learning skills, including literacy, are more difficult to attain. Because literacy plays such a fundamental role in school success, it is critical that teachers meet the challenge of keeping children involved and motivated in this area.

How did you develop SELF to address these challenges?

AD: First, we realized that children at early risk for EBD may not benefit sufficiently from universally delivered, or Tier 1, instruction. We designed SELF to extend prior work in social-emotional and academic learning by providing small group, or Tier 2, instruction for at-risk children within the general education classroom.

Embedding social-emotional learning (SEL) within literacy instruction enables teachers to foster self-regulatory skills that are critical not only for social-emotional adjustment, but also for developing literacy. Using dialogic reading (an interactive strategy where adults and children have a dialogue around the text they are reading to enhance children’s literacy and language skills), SELF teachers can promote “emotion discourse” through interactive storybook reading, which occurs frequently in K-1 classrooms. In SELF, the teacher begins by introducing key concepts and vocabulary to the whole class. This is followed by a small group setting in which the teacher provides additional opportunities to engage the children at risk for EBD in conversations about their feelings and choices while developing listening comprehension. Children learn to identify their feelings using selected vocabulary words and they acquire strategies for regulating those feelings and related behaviors.

Why was it important to develop a social-emotional curriculum that could be implemented during literacy instruction?

NC: In addition to the fact that social-emotional growth and academic learning are inextricably connected, there is constant pressure to demonstrate continuous academic growth. As a result, it is challenging for many teachers to find time during the school day to focus on SEL. Therefore, it was not only conceptually, but also practically, sound to integrate an SEL curriculum within an academic subject taught in the primary grades. Since some children need more intensive and explicit instruction, we combined universally delivered and small group lessons to provide children at risk for EBD additional opportunities to strengthen language related to SEL and engage in social problem solving.

What have you found in the efficacy trial of SELF? 

AD: During our trial, we collected data primarily through teacher reports of children’s knowledge and behaviors related to social-emotional competence and managing emotions, as well as some direct assessments of the children’s vocabulary, language, and self-regulation. Our findings showed that compared to at-risk children in the control condition (in which students received their usual instruction and services), children who were taught SELF lessons had more positive outcomes on measures related to self-regulation, SEL vocabulary, SEL competence, and behavior (externalizing and internalizing challenges, social skills, and school adjustment). These findings suggest that SEL curricula embedded within academic areas such as literacy can be effective.

Teacher feedback about SELF’s feasibility has consistently indicated that teachers like the curriculum and think it benefits their students, particularly those who are reluctant to say much in a whole group setting. Children have more opportunities in the small group to make connections from storybook characters’ experiences and feelings to their own, and introverted children are more likely to express their thoughts and emotions. Because these children do not typically receive as much attention as children at risk for externalizing problems, the evidence that SELF was effective for them was particularly noteworthy.

What are the next steps for your research?

AD: Theoretically speaking, the discourse opportunities provided in the small-group lessons are key to making SEL instruction effective for at-risk students. Over the years, however, many teachers using SELF have expressed a desire to teach the entire curriculum in a whole class setting, reasoning that all children can benefit from the instruction. This preference could indicate either a failure to grasp the fundamental role the small-group lessons play in providing opportunities for developing receptive and expressive social-emotional language, or it could be a practical concern with adding Tier 2 SEL instruction to their already demanding schedules. Therefore, future studies might include more formal qualitative inquiry focused on implementation concerns. We also need to examine whether children from different cultural and ethnic backgrounds respond similarly to SELF lessons. Finally, we would like to examine the pathways through which this model works, such as investigating whether SELF improves SEL language development and/or self-regulation, which then leads to the overall positive behavior and academic outcomes we have observed.

Where can interested school personnel learn more about SELF?

NC: Providing access to validated instructional interventions like SELF is of primary importance to us, so we are currently finalizing a website for interested stakeholders to freely access the curriculum after completing one hour of professional development. The website includes a video overview of SELF and orientation to SEL topics, our research papers and conference presentations, and for those who have completed the PD, the instructional materials and strategies used throughout the lessons.

Ann Daunic, PhD, principal investigator for the SELF research project, is an emeritus scholar in the School of Special Education, School Psychology, and Early Childhood Studies in the University of Florida’s College of Education.

Nancy Corbett, PhD, co-principal investigator, is a retired faculty member in the School of Special Education, School Psychology, and Early Childhood Studies in the University of Florida’s College of Education.

This interview was produced and edited by Julianne Kasper, Virtual Student Federal Service Intern at IES and graduate student in Education Policy & Leadership at American University. Jacquelyn Buckley is the program officer for NCSER’s Social, Emotional, and Behavioral Competence portfolio.

Challenging Implicit Bias in Schools

School environments are places in which students, particularly students of color, are exposed to implicit bias and discrimination that can negatively impact their academic outcomes. In this interview blog, we asked prevention scientist Dr. Chynna McCall to discuss how her career journey and her experiences working with children and families from diverse populations inspired her research on creating equitable school environments.   

 

Chynna McCall PhotoHow did you begin your career journey as a prevention scientist?

Perhaps my most valued professional experience is serving as a licensed school psychologist in public schools in Colorado, working with children and families from racially, culturally, and linguistically diverse populations. This experience inspired me to join the Missouri Prevention Science Institute in 2018 as an Institute of Education Sciences postdoctoral fellow, where I studied how to use research to solve real-world problems. More specifically, I learned how to use prevention science to develop and evaluate evidence-based practices and interventions that prevent negative social and emotional impacts before they happen. After my fellowship, I was hired and promoted to a senior research associate position at the Missouri Prevention Science Institute. In this role, I have operational responsibilities for various federally funded grants and conduct my own grant-funded research. Presently, I am working on the development and testing of an equity-focused social-emotional learning curriculum for 3rd through 5th grade students.

What challenges did you observe as a school psychologist?

As a school psychologist, I worked in two vastly different school districts. In one, most students came from low-income families, spoke English as a second language, and the school's performance on standardized tests was significantly below average. Most of the challenges I tackled during my time there could be categorized as social-emotional; most students had unbalanced home lives, and many suffered emotional or physical trauma. Because the school district pressured teachers to improve test scores, focus on behavior and classroom management unilaterally shifted towards scholastics. The unfortunate outcome was neglecting to acknowledge the role that student behavior and the root causes of those behaviors play in affecting academic outcomes. While the second district I worked for was a high-performing one with generally high socioeconomic status, I chose to work for the school designated for those children in the district who have serious emotional disabilities.

Even though there are stark differences between the two districts, I consistently encountered a need for students to develop better relationships with their teachers, peers, and parents, develop a better sense of self, and for teachers, other school personnel, students, and parents to have a better understanding of how their practices and interactions are impacting student social-emotional and academic outcomes.

How does your background as a school psychologist influence your research?

My experience as a school psychologist has reinforced my understanding of what is needed to improve public education and what research questions are of utmost importance. Through my time as a school psychologist, it helped me define the goals of my research, which include 1) understanding the influence of prejudice and discrimination on student internal and external behaviors and outcomes, 2) understanding how school personnel expression of prejudice and discrimination influence student internal and external behaviors and outcomes, and 3) determining how to most effectively develop an equitable school environment that positively influences marginalized and minoritized youth outcomes.

My research examines how school environment—including the prejudicial and discriminatory thoughts and behaviors of school staff, students, and guardians—influences identity development, identity expression (for example, racial identity, gender identity, sexuality, and intersectionality) and internal and external behaviors. The objective is to use this knowledge to create a school environment that facilitates prosocial student identity development. My research hinges on my observations and experiences as a practicing school psychologist to focus on how to shift differential outcomes observed in public education due to experiences of discrimination both in and out of the school setting.

In your area of research, what do you see as the greatest research needs or recommendations to address diversity and equity and improve the relevance of education research for diverse communities of students and families?

I believe schools at every level of education are microcosms for the greater society. How students traverse through the school system dictates how they will navigate through the macrocosm of society. How students navigate the school system can be improved if school systems are equipped with the tools that allow staff to prepare the students better academically, socially, and emotionally. These tools are essential for students who are having a difficult time because of cultural, linguistic, psychological, or physical differences from their peers. It is crucial for the research community to continually advocate for positive change in our education system, work towards better understanding student needs, and develop effective and efficient tools that better promote student growth and outcomes.

I also believe that researchers who study school environments must explicitly study bias. We have to look at whether and how school professionals are becoming aware of and challenging their implicit biases, as well as how students are becoming aware of bias and how they deal with it—either by internalizing it or challenging it. We also must look into how challenging or accepting bias affects students emotionally, behaviorally, and academically.

What advice would you give to emerging scholars from underrepresented, minoritized groups that are pursuing a career in education research?

See your perspective and experience as assets. Your perspective is underrepresented and is needed in making necessary changes to education and education outcomes. When you view your perspective as something of value, you are better able to determine what unaddressed research questions need to be asked and to move education research in a direction that is more inclusive of every student.


This year, Inside IES Research is publishing a series of interviews (see here, here, and here) showcasing a diverse group of IES-funded education researchers and fellows that are making significant contributions to education research, policy, and practice. As part of our Black History Month blog series, we are focusing on African American/Black researchers and fellows as well as researchers who focus on the education of Black students.

Dr. Chynna McCall is a Senior Research Associate with the Missouri Prevention Science Institute at the University of Missouri. Prior to this position, she was an IES postdoctoral fellow in the Missouri Interdisciplinary Postdoctoral Research and Training Program training program.

Produced by Corinne Alfeld (Corinne.Alfeld@ed.gov), postdoctoral training program officer, and Katina Stapleton (Katina.Stapleton@ed.gov), co-Chair of the IES Diversity and Inclusion Council and predoctoral training program officer.

 

Recognizing School-Based Teams for American Education Week: Team-Initiated Problem Solving (TIPS)

In honor of American Education Week, IES recognizes the many school-based educators and staff who work together to support student learning and growth. This is particularly true for teams working to improve outcomes for students with disabilities. Providing special education requires a team approach with collaboration among a variety of professionals. To this end, school-based teams—teachers, administrators, special education and behavior specialists, and other support professionals—at the elementary level are in a constant process of problem solving. Student needs, ever evolving, are best met using targeted data and evidence-based practices. But how do school teams ensure that they are defining student needs accurately and applying the most effective interventions? In the busy school environment, how can team members best use their meeting time to serve students?

NCSER-funded researchers have been working to measure and support school team efforts through the development of decision-making models and observation tools refined and expanded over the course of more than 15 years. One approach dedicated to training team members and facilitating successful problem-solving meetings has been demonstrated to improve the decisions made by school teams and is now being integrated with student data systems and supported by online tools for staff.

Photo of Dr. Rob Horner

Dr. Rob Horner (University of Oregon) and his team recognized the need for school problem-solving teams to access to student academic and behavioral data and to have a protocol for the effective use of these data. Based on an observational tool, Decision Observation Recording and Analysis (DORA), and a decision-making process developed with a previous NCSER grant, they evaluated the efficacy of Team-Initiated Problem Solving (TIPS). Focused on the school-based team meeting procedures, TIPS helps train school staff to use data to define student problems and develop targeted solutions that draw from existing research but are specific to each student’s unique circumstances and needs. This randomized controlled trial tested the TIPS model with school teams trained in schoolwide Positive Behavioral Interventions and Supports (PBIS), a systems-level framework that involves implementing multi-tiered, evidence-based practices to improve student social/behavioral and academic outcomes. Results indicated that the teams already had fairly strong foundational meeting procedures (such as use of agenda, minutes, and assigned roles) following the general PBIS training, but after exposure to TIPS training and coaching, school teams were better able to identify precise academic and behavioral problems in the students they observed. The solutions they generated were more targeted and, notably, researchers saw a shift from solutions that focused on changing the student to those that aimed to alter the student’s environment. In addition, teams that participated in TIPS were more likely to implement solutions they developed and their schools had fewer out-of-school suspensions than the schools that had teams in the control group.

Although there were positive effects of the TIPS model, it is important to note that drawing together a team of school staff with diverse specialties and relationships with the student remains a challenge. Together with Dr. Horner, Dr. Erin Chaparro (University of Oregon) is leading an IES-funded project to develop a set of technology tools to facilitate the use of TIPS with problem-solving teams. The project includes both online professional development modules tailored to team members’ needs and an app to assist with meeting protocols and easy access to meeting history and student data. These programs, collectively called the TIPS EdTech tools, are intended to improve team functioning and, by extension, student outcomes. The researchers are currently completing a pilot study to help determine the fidelity of implementing these tools and the promise for positive impacts on team functioning and student outcomes.  

TIPS is now being used in additional research. Dr. Wayne Sailor (University of Kansas) and his research team are focused on school teams’ ability to effectively leverage data to integrate student behavioral and academic supports. This NCSER-funded grant aims to improve school teams’ use of an integrated multi-tiered systems of support, which works to combine behavior and academic services, through the development of a decision support system (DSS). The DSS consists of two parts, one of which is an adaptation of the TIPS model for problem-solving team meetings termed “the meeting engine.” The second component consists of an existing digital system called DataWall, an integrated data system to link education databases, chart data, and build summary reports at various levels (such as school, grade, or student). This research team is currently enhancing DataWall while integrating with TIPS procedures.

Serving students with disabilities requires the skills and collaboration of many different education professionals, such as teachers and special education teachers, administrators, service providers, and paraeducators. The challenge of coordinating the efforts of school-based teams calls for ongoing innovation by both researchers and practitioners. TIPS and its iterations are one evidence-based way of helping to facilitate school staff supports for diverse student needs.

Written by Julianne Kasper, Virtual Student Federal Service Intern at IES and graduate student in Education Policy & Leadership at American University.