Inside IES Research

Research identifies benefits of access to same-race/ethnicity teachers for Black and Hispanic students. However, the teacher workforce is overwhelmingly White, and little is known about the system-level strategies that are successful at diversifying the profession. In recognition of Black History Month, we asked researcher Dr. David Blazar to discuss his recently awarded IES project that aims to advance the literature base on how school systems can recruit more Black teachers. This is what he shared.

What does existing research say about the need for more Black teachers?

Building on a longstanding theoretical and qualitative literature base from scholars including Gloria Ladson-Billings, Geneva Gay, Richard Milner, and many others, researchers have gathered causal evidence to support the claim of the benefit of Black teachers to Black students. Analyzing test score data from Tennessee's Project STAR experiment, Dee (2004) found that assignment to a Black teacher significantly increased the math and reading achievement of Black students.

Fast forward 18 years, and the research findings largely remain the same while the evidence base has grown substantially (see one meta-analysis, and a research synthesis). In the second experiment on this topic after Dee, my own recent analyses currently available in a working paper not only replicate the earlier test-score impacts, but also show that

• Test-scores effects (roughly 0.2 SD) persist at very similar magnitudes 6 years later when students are in high school, a rare pattern in education research
• Black and other underrepresented teachers of color have even larger effects (upwards of 0.45 SD) on the social-emotional development of their students of color and their White students
• Black and other teachers of color are much more likely than White teachers to hold mindsets and engage in classroom practices aligned to “culturally responsive teaching,” which in turn benefits a range of student outcomes

In short: The effects of Black teachers on the outcomes of Black students are larger than those of most other interventions as documented in the broader education research literature (generally no higher than 0.1 SD).

I pair these hugely meaningful findings with three more sobering facts:

• Black teachers are underrepresented in the teacher workforce. Roughly 7% of teachers nationally are Black, compared to roughly 15% of students. These patterns have not shifted much over the last several decades, even though calls to diversify the teacher workforce started over 30 years ago.
• The mismatch between student and teacher demographics may be due to “leaks” at multiple stages of the school-to-career pipeline, including lower rates of high school graduation amongst Black students relative to their White peers, similar gaps in college graduation rates, less interest in teaching as a career, and greater financial barriers and opportunity costs even when the interest is there.
• Despite impressive work by educators, scholars, and policymakers to design multiple strategies for recruiting Black individuals into teaching, the bulk of these remain “promising practices” rather than evidence-based best practices.

How will your IES-funded study address the need for more Black teachers?

Because the underrepresentation of Black teachers in U.S. schools is notable and longstanding, researchers and school systems must work together—and quickly—to consider multiple strategies. Stating that we need to diversify the teacher workforce is neither new nor novel. The imperative was posed several decades ago, and it is time that we figure out how best to do it.

To address this challenge head on, I am collaborating with Ramon Goings, Seth Gershenson, and other scholars, as well as with state agencies and policy actors in Maryland to explore several recruitment strategies aimed at diversifying the teacher workforce, implemented at different stages of the school-to-career pipeline.

Aligned to the theoretical literature, a core feature of our study is that we focus on strategies that look locally for prospective teaching talent and are therefore known as “grow-your-own” programs. These approaches aim to align the demographics of incoming teachers with the demographics of current student populations and ensure that those incoming teachers are familiar with the local area. We further designed our study to explore multiple components of and potential solutions to the policy problem, given that recruitment is unlikely to be addressed with a one-size-fits-all approach. Even though the partnership and data come from Maryland, the recruitment strategies and our study are relevant to the recruitment strategies used in states across the country.

The three strategies are—

• Early exposure to teaching in high school through the Teacher Academy of Maryland—a career and technical education program of study—that provides high school students with an opportunity to learn about teaching as a career, gain teaching experience in a real-world classroom, and earn an associate’s degree in teaching alongside their high school diploma.
• Financial support and incentives for college students, including the recently implemented Teaching Fellows for Maryland Scholarship. Scholarships aim to decrease financial barriers and opportunity costs that may prevent Black individuals from becoming teachers.
• Career-changer programs, such as alternative-route teacher certification and residency programs that both decrease barriers to entry into the profession and focus on recruiting locally.

Our analyses will provide some of the first quantitative data linking the rollout of varied recruitment strategies and the workforce decisions of prospective Black teachers. Beyond analyses of each individual program, our findings will provide important guidance not only about how best to intervene but also when to do so. We look forward to sharing what we find and to building an evidence base alongside other scholars and funding agencies tackling this important issue.

David Blazar is an Assistant Professor at the University of Maryland College Park (UMCP) in the Education Policy and Leadership program. He also is the Faculty Director of the Maryland Equity Project, a UMCP initiative to improve educational outcomes and close achievement gaps through research.

This interview blog is part of a larger IES blog series on diversity, equity, inclusion and accessibility (DEIA) in the education sciences. It was produced by Katina Stapleton (Katina.Stapleton@ed.gov), co-Chair of the IES Diversity and Inclusion Council, and Wai-Ying Chow (Wai-Ying.Chow@ed.gov), the Effective Instruction program officer within the National Center for Education Research.

Improving the social and emotional climate of schools has become a growing priority for educators and policymakers in the past decade. The prevailing strategies for improving school climate include social and emotional learning, positive behavioral supports, and trauma-informed approaches. Many of these strategies foreground the importance of students having a voice in intervention, as students are special experts in their own social and emotional milieus.

Parallel to this trend has been a push toward student-centered pedagogical approaches in high schools that are responsive to cultural backgrounds and that promote skills aligned with the demands of the modern workplace, like critical thinking, problem-solving, and collaboration. Culturally responsive and restorative teaching and problem- and project-based learning are prominent movements. In this guest blog, Dr. Adam Voight at Cleveland State University discusses an ongoing IES-funded Development and Innovation project taking place in Cleveland, Ohio that aims to develop and document the feasibility of a school-based youth participatory action research intervention.

Our project is exploring how youth participatory action research (YPAR) may help to realize two objectives—school climate improvement and culturally-restorative, engaged learning. YPAR involves young people leading a cycle of problem identification, data collection and analysis, and evidence-informed action. It has long been used in out-of-school and extracurricular spaces to promote youth development and effect social change. We are field testing its potential to fit within more formal school spaces.

Project HighKEY

The engine for our project, which we call Project HighKEY (High-school Knowledge and Education through YPAR), is a design team composed of high school teachers and students, district officials, and university researchers. It is built from the Cleveland Alliance for Education Research, a research-practice partnership between the Cleveland Metropolitan School District, Cleveland State University, and the American Institutes for Research. The design team meets monthly to discuss YPAR theory and fit with high school curriculum and standards and make plans for YPAR field tests in schools. We have created a crosswalk of the documented competencies that students derive from YPAR and high school standards in English language arts (ELA), mathematics, science, and social studies in Ohio. For example, one state ELA standard is “Write arguments to support claims in an analysis of substantive topics or texts, using valid reasoning and relevant and sufficient evidence,” and through YPAR students collect and analyze survey and interview data and use their findings to advocate for change related to their chosen topic. A state math standard is “Interpret the slope and the intercept of a linear model in the context of data,” and this process may be applied to survey data students collect through YPAR, making an otherwise abstract activity more meaningful to students.  

Assessing the Effectiveness of YPAR

Remaining open-minded about the various ways in which YPAR may or may not fit in different high school courses, we are currently testing its implementation in a pre-calculus course, a government course, an English course, and a life-skills course. For example, a math teacher on our design team has built her statistics unit around YPAR. Students in three separate sections of the course have worked in groups of two or three to identify an issue and create a survey that is being administered to the broader student body. These issues include the lack of extracurricular activities, poor school culture, and unhealthy breakfast and lunch options. Their survey data will be used as the basis for learning about representing data with plots, distributions, measures of center, frequencies, and correlation after the winter holiday. Our theory is that students will be more engaged when using their own data on topics of their choosing and toward the goal of making real change. Across all of our project schools, we are monitoring administrative data, student and teacher survey data, and interview data to assess the feasibility, usability, and student and school outcomes of YPAR.

Impact of COVID-19 and How We Adapted

We received notification of our grant award in March 2020, the same week that COVID-19 shut down K-12 schools across the nation. When our project formally began in July 2020, our partner schools were planning for a wholly remote school year, and we pivoted to hold design team meetings virtually and loosen expectations for teacher implementation. Despite these challenges, several successful YPAR projects during that first year—all of which were conducted entirely remotely—taught all of us much about how YPAR can happen in online spaces. This school year, students and staff are back to in-person learning, but, in addition to the ongoing pandemic, the crushing teacher shortage has forced us to continue to adapt. Whereas we once planned our design team meeting during the school day, we now meet after school due to a lack of substitute teachers, and we use creative technology to allow for mixed virtual and in-person attendance. Our leadership team is also spending a great deal of time in classrooms with teachers to assist those implementing for the first time. Our goal is to create a resource that teachers anywhere can use to incorporate YPAR into their courses. The product will be strengthened by the lessons we have learned from doing this work during these extraordinary times and the resulting considerations for how to deal with obstacles to implementation.

Adam Voight is the Director of the Center for Urban Education at Cleveland State University.

For questions about this grant, please contact Corinne Alfeld, NCER Program Officer, at Corinne.Alfeld@ed.gov.

Under an IES grant, Michigan State University, in collaboration with the Michigan Department of Education, the Michigan Center for Educational Performance and Information, and the University of Michigan, is assessing the implementation, impact, and cost of the Michigan “Read by Grade 3” law intended to increase early literacy outcomes for Michigan students. In this guest blog, Dr. Tanya Wright and Lori Bruner discuss how they were able to quickly pivot to a remote data collection plan when COVID-19 disrupted their initial research plan.  

The COVID-19 pandemic began while we were planning a study of early literacy coaching for the 2020-2021 academic year. It soon became abundantly clear that restrictions to in-person research would pose a major hurdle for our research team. We had planned to enter classrooms and record videos of literacy instruction in the fall. As such, we found ourselves faced with a difficult choice: we could pause our study until it became safer to visit classrooms and miss the opportunity to learn about literacy coaching and in-person classroom instruction during the pandemic, or we could quickly pivot to a remote data collection plan.

Our team chose the second option. We found that there are multiple technologies available to carry out remote data collection. We chose one of them (a device known as the Swivl) that included a robotic mount, where a tablet or smartphone can be placed to take the video, with a 360-degree rotating platform that works in tandem with a handheld or wearable tracker and an app that allows videos to be instantly uploaded to a cloud-based storage system for easy access.

Over the course of the school year, we captured over 100 hours of elementary literacy instruction in 26 classrooms throughout our state. While remote data collection looks and feels very different from visiting a classroom to record video, we learned that it offers many benefits to both researchers and educators alike. We also learned a few important lessons along the way.

First, we learned remote data collection provides greater flexibility for both researchers and educators. In our original study design, we planned to hire data collectors to visit classrooms, which restricted our recruitment of schools to a reasonable driving distance from Michigan State University (MSU). However, recording devices allow us to capture video anywhere, including rural areas of our state that are often excluded from classroom research due to their remote location. Furthermore, we found that the cost of purchasing and shipping equipment to schools is significantly less than paying for travel and people’s time to visit classrooms. In addition, using devices in place of data collectors allowed us to easily adapt to last-minute schedule changes and offer teachers the option to record video over multiple days to accommodate shifts in instruction due to COVID-19.

Second, we discovered that we could capture more classroom talk than when using a typical video camera. After some trial and error, we settled on a device with three external wireless microphones: one for the teacher and two additional microphones to place around the classroom. Not only did the extra microphones record audio beyond what the teacher was saying, but we learned that we can also isolate each microphone during data analysis to hear what is happening in specific areas of the classroom (even when the teacher and children were wearing masks). We also purchased an additional wide-angle lens, which clipped over the camera on our tablet and allowed us to capture a wider video angle.  

Third, we found remote data collection to be less intrusive than sending a research team into schools. The device is compact and can be placed on any flat surface in the classroom or be mounted on a basic tripod. The teacher has the option to wear the microphone on a lanyard to serve as a hands-free tracker that signals the device to rotate to follow the teacher’s movements automatically. At the end of the lesson, the video uploads to a password-protected storage cloud with one touch of a button, making it easy for teachers to share videos with our research team. We then download the videos to the MSU server and delete them from our cloud account. This set-up allowed us to collect data with minimal disruption, especially when compared to sending a person with a video camera to spend time in the classroom.

As with most remote work this year, we ran into a few unexpected hurdles during our first round of data collection. After gathering feedback from teachers and members of our research team, we were able to make adjustments that led to a better experience during the second round of data collection this spring. We hope the following suggestions might help others who are considering such a device to collect classroom data in the future:

1. Consider providing teachers with a brief informational video or offering after-school training sessions to help answer questions and address concerns ahead of your data collection period. We initially provided teachers with a detailed user guide, but we found that the extra support was key to ensuring teachers had a positive experience with the device. You might also consider appointing a member of your research team to serve as a contact person to answer questions about the remote data collection during data collection periods.
2. As a research team, it is important to remember that team members will not be collecting the data, so it is critical to provide teachers with clear directions ahead of time: what exactly do you want them to record? Our team found it helpful to send teachers a brief two-minute video outlining our goals and then follow up with a printable checklist they could use on the day they recorded instruction. 
3. Finally, we found it beneficial to scan the videos for content at the end of each day. By doing so, we were able to spot a few problems, such as missing audio or a device that stopped rotating during a lesson. While these instances were rare, it was helpful to catch them right away, while teachers still had the device in their schools so that they could record missing parts the next day.

Although restrictions to in-person research are beginning to lift, we plan to continue using remote data collection for the remaining three years of our project. Conducting classroom research during the COVID-19 pandemic has proven challenging at every turn, but as we adapted to remote video data collection, we were pleased to find unanticipated benefits for our research team and for our study participants.

This blog is part of a series focusing on conducting education research during COVID-19. For other blog posts related to this topic, please see here.

Tanya S. Wright is an Associate Professor of Language and Literacy in the Department of Teacher Education at Michigan State University.

Lori Bruner is a doctoral candidate in the Curriculum, Instruction, and Teacher Education program at Michigan State University.

In response to a call from IES for research on how to best support postsecondary teachers and students to thrive in online environment, NCER is establishing a new research and development (R&D) center. This center, led by SRI International (SRI) and the Community College Research Center (CCRC) at Teachers College (Columbia University), aims to help faculty embed support for self-directed learning skills into their online and hybrid courses.

This R&D center will support postsecondary instructors in making optimal use of technology features often available in online course tools to bolster student self-management strategies. Through its research and capacity-building programs, the center aims to strengthen teaching and learning, improve student outcomes, and ensure all students—regardless of race, ethnicity, or socioeconomic status—have equitable learning opportunities and attainment in broad-access institutions.

“Lack of self-directed learning skills can hinder a student’s success in any college course,” says SRI’s Rebecca Griffiths, a lead researcher in the new center, “but the challenge is greater in online courses, which typically place more responsibility on students to manage their own learning.”

Self-directed learning skills, also known as self-regulated learning skills, encompass three interrelated and mutually reinforcing areas:

• Affect, which includes self-efficacy and the motivation to learn
• Strategic actions, which include planning, goal setting, strategies to organize, code, and rehearse
• Metacognition, which includes self-monitoring, self-evaluating and self-correction

These three areas can form a virtuous cycle. When students believe that studying helps them learn important and useful knowledge, they are more likely to study strategically and effectively. Effective study habits in turn enhance academic performance and build positive mindsets including confidence, motivation around learning, and a sense of personal growth.

SRI and CCRC will partner with Achieving the Dream and nine broad-access, public colleges, and universities across the U.S. to conduct these research program activities.

The research goals of the R&D center are to—

• Generate new knowledge about how faculty can effectively use technology features and instructional practices in online STEM courses to create a positive feedback loop for students
• Shed light on institutional policies and practices and instructional environments needed to support a coherent, intentional, and sustainable approach to helping students build self-directed learning skills across their coursework
• Develop and pilot a technology-enabled, skills development model that will use technology features already widely available in learning management systems, adaptive courseware, and mobile apps to deliver instruction on these skills
• Using research findings to inform the development of a rich, interactive toolkit to support institutions and faculty as they implement self-directed learning skills instruction at scale in online programs.

In addition to carrying out the research activities, the center will provide national leadership and capacity-building activities for postsecondary teaching and learning. Through partnership with Achieving the Dream, technology developers, researchers, education equity advocates, and others, the center will establish the critical importance of integrating self-directed learning into instruction to improve teaching and learning and improve equity in postsecondary student outcomes. They will also engage faculty, instructional designers, and educational technology developers to share knowledge and to co-develop and disseminate capacity-building resources that support teaching these skills and strategies. 

The center is led by Dr. Deborah Jonas (PI, SRI International, top photo), Dr. Nicole Edgecombe (Co-PI, Teachers College, Columbia University), Dr. Rebecca Griffiths (Co-PI, SRI International), and Dr. Neil Seftor (Co-PI, SRI International).

This blog was written by the R&D center team. For further information about the grant, contact the program officer: Dr. Meredith Larson.

The ED Games Expo is an annual showcase of game-changing innovations in education technology developed through programs at ED and across the federal government. Since 2013, the Expo has been an in-person event at venues across Washington, D.C. Because of COVID-19, the 2021 Expo will be an entirely virtual experience from June 1 to 5.

This year, the Expo will showcase more than 160 learning games and technologies and feature 35 different virtual EdTech events of interest to a broad audience of viewers. See the Agenda for the lineup for the Ed Games Expo.

ED Games Expo: Featuring INSIGHTS into Children’s Temperament

INSIGHTS into Children’s Temperament, an IES-supported intervention, is being featured at the Expo this year. INSIGHTS supports children’s social-emotional development and academic learning by helping teachers and parents see how differences in children’s behavior might reflect temperament/personality. Children work with the INSIGHTS puppets and learn that other children and adults react differently to the same situation due to their temperaments. IES has supported two randomized controlled trials (RCTs, the “gold standard” for claims of impact) of INSIGHTS – one in New York City and the other (ongoing) in rural Nebraska. Evidence from the NYC RCT and a longitudinal follow up indicate that children who participate in the INSIGHTS program during early elementary school experience better academic and social behavioral outcomes immediately following participation in the program, and these positive impacts persist into middle school. 

During the 2020 ED Games Expo, Sandee McClowry and her team performed an INSIGHTS lesson at the Kennedy Center to hundreds of attendees, including children, students, and families. INSIGHTS will be featured in this year’s ED Games Expo in three ways.

• Tuesday, June 1 at 8PM Eastern: There will be an “ED Games Expo Kick Off Show” hosted by the puppets from the INSIGHTS intervention and the characters from the Between the Lions children’s television program. All of the characters will share information about the ED Games Expo while having a lot of fun and hijinks on a road trip to Washington, DC.  The Show will be introduced by the Secretary of Education, Miguel Cardona, and will also feature cameo appearances by IES, ED, and government team members.
• Wednesday, June 2 from 9PM to 9:45PM Eastern: Sandee McClowry will be hosting a Master Class for Educators. The event will introduce all of the INSIGHTS friends, including Coretta the Cautious, Gregory the Grumpy, Fredrico the Friendly, and Hilary the Hard Worker. The video will provide practical guidance to educators on how to deliver the intervention in a classroom. The event will conclude with a rich and engaging discussion with expert practitioners about how INSIGHTS addresses the social and emotional learning of children, educators, and parents. Click Here to access the YouTube broadcast of the Master Class and set a reminder to watch on June 1.
• Materials from INSIGHTS, including puppets that can be printed out and professional development resources for educators, will be available to try out during the Expo and in the month of June.

For URL links to watch the ED Games Expo Kick Off Show and Master Class for Educators, See the Agenda. For more information and on how to access the resources INSIGHTS intervention, see the website.

Written by Emily Doolittle (Emily.Doolittle@ed.gov), NCER Team Lead for Social Behavioral Research at IES