Inside IES Research

Notes from NCER & NCSER

Cost Analysis in Practice (CAP) Project Provides Guidance and Assistance

In 2020, as part of a wider IES investment in resources around cost, IES funded the Cost Analysis in Practice (CAP) Project, a 3-year initiative to support researchers and practitioners who are planning or conducting a cost analysis of educational programs and practices. The CAP Project Help Desk provides free on-demand tools, guidance, and technical assistance, such as support with a cost analysis plan for a grant proposal. After inquiries are submitted to the Help Desk, a member of the CAP Project Team reaches out within two business days. Below is a list of resources that you can access to get more information about cost analysis.

 

STAGES FOR CONDUCTING A COST ANALYSIS

 

CAP Project Resources

Cost Analysis Standards and Guidelines 1.0: Practical guidelines for designing and executing cost analyses of educational programs.

IES 2021 RFAs Cost Analysis Requirements: Chart summarizing the CAP Project’s interpretation of the IES 2021 RFAs cost analysis requirements.

Cost Analysis Plan Checklist: Checklist for comprehensive cost analysis plans of educational programs and interventions.

Introduction to Cost Analysis: Video (17 mins).

 

General Cost Analysis Resources

The Critical Importance of Costs for Education Decisions: Background on cost analysis methods and applications.

Cost Analysis: A Starter Kit: An introduction to cost analysis concepts and steps.

CostOut®: Free IES-funded software to facilitate calculation of costs once you have your ingredients list, includes database of prices.

DecisionMaker®: Free software to facilitate evidence-based decision- making using a cost-utility framework.

Cost-Effectiveness Analysis of Early Reading Programs: A Demonstration With Recommendations for Future Research: Open access journal article.

 

*More resources available here.


The content for this blog has been adapted from the Cost Analysis in Practice Project informational flyer (CAP Project, 2020) provided by the CAP Project Team. To contact the CAP Help Desk for assistance, please go to https://capproject.org/. You can also find them on Twitter @The_CAP_Project.

IES Grantees Receive SPR Awards

Photo of Elizabeth Stormshak, Dorothy Espelage, and Patrick Tolan

Three IES-funded investigators were presented with awards from the Society for Prevention Research (SPR) last week. We recognize and applaud these investigators (pictured above from left to right) Elizabeth Stormshak, Dorothy Espelage, and Patrick Tolan.

Dr. Elizabeth Stormshak, Philip H. Knight Chair and Department Head for Counseling Psychology and Human Services at University of Oregon, received the Translational Science Award from SPR. This award is given to an individual or a team of individuals in recognition for contributions to the field of prevention science through translational research. Dr. Stormshak’s research focuses on understanding risk factors in early and middle childhood associated with the development of problem behavior in late adolescence, including substance use and delinquency. She also studies the process of disseminating evidence-based interventions into real world community settings. She has been the Principal Investigator on multiple IES grants, including a 2018 NCSER-funded project to examine the long-term efficacy of the Kindergarten Family Check-Up (FCU), a school-based, family-centered intervention intended to prevent student social and behavioral problems. This grant is a follow-up and extension to her recently completed randomized controlled trial of Kindergarten FCU, funded by NCER, which found positive impacts on student behavior and academic outcomes during and up to 3 years after the transition to kindergarten. The primary aims of the newer grant are to determine the long-term impact of receiving the original kindergarten intervention and the effects of a middle school booster session of FCU on students' behavior and academic outcomes. Dr. Stormshak is also the director of a NCSER-funded postdoctoral training program focused on the prevention of school-based social and behavioral problems.

Dr. Dorothy Espelage, William C. Friday Distinguished Professor of Education at the University of North Carolina, Chapel Hill, received SPR’s Prevention Science Award. This award is given for the application of scientific methods to develop and test prevention strategies. Dr. Espelage is a leading expert on school safety and has led multiple research studies on school-based violence and bullying. She has been involved in several IES grants. Most recently, she is serving as the Principal Investigator of a 2019 NCSER-funded project to develop and test a professional development program aimed at enhancing elementary school teachers' knowledge and skills for identifying, mitigating, and preventing bullying among students with and without disabilities. Dr. Espelage also led an exploratory study funded by NCER to better understand how teacher practices influence elementary school students’ interpersonal relationships in the classroom and related behavioral outcomes. 

Dr. Patrick H. Tolan, Charles S. Robb Professor of Education at the University of Virginia in the Curry School of Education and in the Department of Psychiatry and Neurobehavioral Sciences in the School of Medicine, and Director Emeritus of the YouthNex Center in the UVA Center to Promote Effective Youth Development, received the Advances in Culture and Diversity in Prevention Science Award as one of three founding members of the Boys of Color Collaborative. This award is given for contributions to the field of prevention science in the area of community and culture. Dr. Tolan’s research career spans 34 years with a focus on program evaluation for promoting positive youth development and preventing youth violence. Dr. Tolan is currently the Principal Investigator of a 2019 Follow-Up study of an IES efficacy study of the integration of two prevention programs, Good Behavior Game and My Teaching Partner (GBG+MTP), for teachers who have recently entered the teaching profession.

Congratulations to the award recipients!

This blog was co-authored by Jackie Buckley (NCSER), Katie Taylor (NCSER), Emily Doolittle (NCER), and Amy Sussman (NCSER).

 

IES is Providing Digital Technical Assistance for FY 2021 Research Grant Applicants

Given the many challenges that this year has brought, including the difficulties and uncertainties due to the COVID-19 pandemic, IES is providing different resources and options to assist applicants as they begin preparing their applications. To ensure that program officers can focus their time on project-specific questions, applicants should review these resources first before seeking individual feedback.

First, have a copy of the documents that are needed to submit a proposal. Download a copy of the relevant request for applications (RFA) and the IES Application Submission Guide. This page has PDFs of these documents: https://ies.ed.gov/funding/21rfas.asp. Also, download the application package (search for CFDA 84.305) from https://grants.gov/. Contact Grants.gov (1-800-518-4726; support@grants.gov) if you need help with your electronic grant submission.

 

Next, take advantage of our digital technical assistance options.

  • On-demand webinars. These pre-recorded webinars answer questions about the grant competitions, how to apply, and how to prepare a strong application. You can access them here: https://ies.ed.gov/funding/webinars/.  

 

  • Virtual office hours. This year, we will host a series of drop-in hours during which a program officer will answer questions and give technical assistance. These office hours will help determine which competition or project type is the best fit and also understand some of the requirements and recommendations in the RFAs. Please see the schedule below along with the call-in information. This information is also posted here.

 

  • Cost analysis/Cost-effectiveness analysis. Many RFAs require a cost analysis plan, and some also require a cost effectiveness plan.  Please refer to our list of resources for developing these plans: https://ies.ed.gov/seer/cost_analysis.asp.

 

 

Finally, please make sure that you attend to the application due dates: https://ies.ed.gov/funding/futureComp.asp because IES does not accept late applications.

 

Virtual Office Hours

Staff from the research centers will host hour-long drop-in virtual sessions to provide technical assistance around particular competitions or research project types or for general purposes. Applicants are encouraged to join in the discussion and ask questions. These sessions are especially helpful if you are unsure of which competition or project type is the best match for you or if you are unclear on any changes to the requirements or recommendations. Below is a list of the current sessions and their topics. Please attend as many sessions as you would like.

All office hours will use the same call-in details. The program officer will allow participants into the meeting from the “lobby” at the beginning. We recommend you do not use video so that there is sufficient bandwidth. All times are shown in Eastern Standard time.

 

Join Microsoft Teams Meeting

+1 202-991-0393   United States, Washington DC (Toll)

Conference ID: 915 412 787#

 

If you would like to request accommodations (e.g., TTY), please send an email to NCER.Commissioner@ed.gov with this request as soon as possible.

You may have to download a free mobile application to use Microsoft Teams if you want the full audio and visual experience from your phone. Clicking on the linked “Join” hyperlink below should prompt you to do this. You can also refer to this article for information: https://support.microsoft.com/en-gb/office/set-up-your-teams-mobile-apps-1ba8dce3-1122-47f4-8db6-00a4f93117e8

 

 

Virtual Office Hours Schedule

 

 

Monday, June 22

Tuesday, June 23

Wednesday, June 24

Thursday, June 25

12:30 – 1:30 pm ET

Competition fit: this will cover all NCER grant competitions and items such as applicant eligibility, general requirements, submission questions, and the IES review process.

Efficacy/Follow-Up and Replication: this will cover characteristics of high-quality projects of these types.

Exploration projects: this will cover characteristics of high-quality projects of this type.

Development projects: this will cover characteristics of high-quality projects of this type.

2:00 – 3:00 pm ET

Exploration projects: this will cover characteristics of high-quality projects of this type.

Development projects: this will cover characteristics of high-quality projects of this type.

Is 305A (Education Research Grants) right for me? This will address general questions about CFDA 84.305A

Measurement projects: this will cover characteristics of high-quality projects of this type.

 

 

Monday, June 29

Tuesday, June 30

Wednesday, July 1

Thursday, July 2

12:30 – 1:30 pm ET

Development projects: this will cover characteristics of high-quality projects of this type.

Exploration projects: this will cover characteristics of high-quality projects of this type.

Measurement projects: this will cover characteristics of high-quality projects of this type.

 

2:00 – 3:00 pm ET

Competition fit: this will cover all NCER grant competitions and items such as applicant eligibility, general requirements, submission questions, and the IES review process.

Systematic Replication: this will focus on the requirements for a 305R or 324R application

Efficacy/Follow-Up: this will cover characteristics of high-quality projects of this type.

Pathways to the Education Sciences: this will address common questions about this training program opportunity.  

 

Addressing Persistent Disparities in Education Through IES Research

A teacher and students smiling and sitting cross legged in a circle

Spring 2020 has been a season of upheaval for students and educational institutions across the country. Just when the conditions around the COVID-19 pandemic began to improve, the longstanding symptoms of a different wave of distress resurfaced. We are seeing and experiencing the fear, distrust, and confusion that are the result of systemic racism and bigotry. For education stakeholders, both the COVID-19 pandemic and the civil unrest unfolding across the country accentuate the systemic inequities in access, opportunities, resources, and outcomes that continue to exist in education.

IES acknowledges these inequities and is supporting rigorous research that is helping to identify, measure, and address persistent disparities in education.

In January (back when large gatherings were a thing), IES hosted its Annual Principal Investigator’s (PI) Meeting with the theme of Closing the Gaps for All Learners. The theme underscored IES's objective of supporting research that improves equity in education access and outcomes. Presentations from IES-funded projects focusing on diversity, equity, and inclusion were included throughout the meeting and can be found here. In addition, below are highlights of several IES-funded studies that are exploring, developing, or evaluating programs, practices, and policies that education stakeholders can implement to help reduce bias and inequities in schools.

 

 

 

  • The Men of Color College Achievement (MoCCA) Project - This project addresses the problem of low completion rates for men of color at community colleges through an intervention that provides incoming male students of color with a culturally relevant student success course and adult mentors. In partnership with the Community College of Baltimore County, the team is engaged in program development, qualitative data collections to understand student perspectives, and an evaluation of the success course/mentorship intervention. This project is part of the College Completion Network and posts resources for supporting men of color here.

 

  • Identifying Discrete and Malleable Indicators of Culturally Responsive Instruction and Discipline—The purpose of this project is to use the culturally responsive practices (CRP) framework from a promising intervention, Double Check, to define and specify discrete indicators of CRPs; confirm and refine teacher and student surveys and classroom direct observation tools to measure these discrete indicators; and develop, refine, and evaluate a theory of change linking these indicators of CRPs with student academic and behavioral outcomes.

 

 

  • The Early Learning Network (Supporting Early Learning From Preschool Through Early Elementary School Grades Network)—The purpose of this research network is to examine why many children—especially children from low-income households or other disadvantaged backgrounds—experience academic and social difficulties as they begin elementary school. Network members are identifying factors (such as state and local policies, instructional practices, and parental support) that are associated with early learning and achievement from preschool through the early elementary school grades.
    • At the January 2020 IES PI Meeting, Early Learning Network researchers presented on the achievement gaps for early learners. Watch the video here. Presentations, newsletters, and other resources are available on the Early Learning Network website.

 

  • Reducing Achievement Gaps at Scale Through a Brief Self-Affirmation Intervention—In this study, researchers will test the effectiveness at scale of a low-cost, self-affirmation mindset intervention on the achievement, behavior, and attitudes of 7th grade students, focusing primarily on Black and Hispanic students. These minority student groups are susceptible to the threat of conforming to or being judged by negative stereotypes about the general underperformance of their racial/ethnic group ("stereotype threat"). A prior evaluation of this intervention has been reviewed by the What Works Clearinghouse and met standards without reservations.

 

 

IES seeks to work with education stakeholders at every level (for example, students, parents, educators, researchers, funders, and policy makers) to improve education access, equity, and outcomes for all learners, especially those who have been impacted by systemic bias. Together, we can do more.

This fall, IES will be hosting a technical working group on increasing the participation of researchers and institutions that have been historically underutilized in federal education research activities. If you have suggestions for how IES can better support research to improve equity in education, please contact us: NCER.Commissioner@ed.gov.  


Written by Christina Chhin (Christina.Chhin@ed.gov), National Center for Education Research (NCER).  

This is the fourth in a series of blog posts that stems from the 2020 Annual Principal Investigators Meeting. The theme of the meeting was Closing the Gaps for All Learners and focused on IES’s objective to support research that improves equity in access to education and education outcomes. Other posts in this series include Why I Want to Become an Education Researcher, Diversify Education Sciences? Yes, We Can!, and Closing the Opportunity Gap Through Instructional Alternatives to Exclusionary Discipline.

Addressing Mental Health Needs in Schools PreK to 12: An Update

As the month of May draws to a close in this unprecedented time of COVID-19, recognizing May as National Mental Health Awareness Month has taken on new significance. Organizations such as the National Association of School Psychologists (NASP) have long advocated for school-based mental health services to address the lack of access to mental health treatment in the United States for children and youth. In a 2016 blog, we provided a snapshot of the PreK to 12 school-based mental health research that the National Center for Education Research (NCER) had supported up to that point. With schools closed and uncertainty about when they will open, we are keeping an eye on these and more recent projects to see how IES-funded researchers and their school partners have addressed or are addressing mental health needs.

Preschool

  • Jason Downer (University of Virginia) developed the Learning to Objectively Observe Kids (LOOK) protocol to help prekindergarten teachers identify and understand children’s engagement in preschool and choose appropriate techniques to support children’s self-regulation skills.

Elementary School

  • Golda Ginsburg (University of Connecticut) and Kelly Drake (Johns Hopkins University) developed the CALM (Child Anxiety Learning Modules) protocol for elementary school nurses to work with children who have excessive anxiety.
  • Desiree Murray (University of North Carolina, Chapel Hill) is testing the Incredible Years Dina Dinosaur Treatment Program (IY-child) for helping early elementary school students with social-emotional and behavioral difficulties. This study is nearly complete, and findings will be available soon.
  • Gregory Fabiano (SUNY-Buffalo) adapted the Coaching Our Acting Out Children: Heightening Essential Skills (COACHES) program for implementation in schools. This is a clinic-based program to help fathers of children with or at risk for attention-deficit/hyperactivity disorder (ADHD) get more involved and engaged in their child's school performance. 
  • Aaron Thompson (University of Missouri) is testing the Self-Monitoring Training and Regulation Strategy (STARS) intervention to see if it can improve behavior, social emotional learning skills, and academic performance for fifth grade students who engage in disruptive or otherwise challenging classroom behaviors. The pilot study of promise is currently in progress.
  • Karen Bierman (Pennsylvania State University) is testing whether an intensive, individualized social skills training program, the Friendship Connections Program (FCP), can remediate the serious and chronic peer difficulties that 10–15 percent of elementary school students experience. Most of these students have or are at risk for emotional or behavioral disorders and exhibit social skill deficits (for example, poor communication skills, inability to resolve conflict) that alienate peers. This study is almost complete, and findings should be available soon.
  • Linda Pfiffner (UC San Francisco) is completing development of a web-based professional development program for school mental health providers to gain the skills needed to implement evidence-based practices (EBPs) for student attention and behavior problems.

Middle School

  • Joshua Langberg (Virginia Commonwealth University) refined the HOPS (Homework, Organization, and Planning Skills) program for middle school counselors and psychologists to support students with ADHD who need help with organization and time management. Dr. Langberg recently completed an efficacy trial of HOPS. In 2019, an independent research team at Children’s Hospital of Philadelphia received a grant to test the effectiveness of HOPS.
  • William Pelham (Florida International University) and colleagues at SUNY Buffalo are testing the efficacy of adaptive, evidence-based classroom interventions (such as Tier 1 and Tier 2 interventions delivered through a Response to Intervention framework) for children with ADHD in a Sequential Multiple Assignment Randomized Trial (SMART) design framework.
  • Thomas Power (Children’s Hospital of Philadelphia) is testing the efficacy of a school-based organizational skills training program (OST-S) for students in 3rd through 5th grade with deficits in organization, time management, and planning (OTMP), key executive function skills that support success in school.
  • Desiree Murray (UNC Chapel Hill) is completing the development of a self-regulation intervention for middle school students. The intervention will adapt and integrate strategies from existing evidence-based practices that intentionally target self-regulatory processes that develop during early adolescence.
  • Catherine Bradshaw (University of Virginia) is adapting the Early Adolescent Coping Power (EACP) to the rural school context. The Rural-EACP will address the cultural and contextual challenges of providing appropriate supports to help youth with aggressive behavior challenges in rural settings.   

High School

Policy

  • Sandra Chafouleas (University of Connecticut) identified current policies and national practice related to school-based behavioral assessment to determine whether current practice follows recommended best practice, and to develop policy recommendations for behavioral screening in schools. 

Written by Emily Doolittle (Emilly.Doolittle@ed.gov), Team Lead for Social and Behavioral Research at IES, National Center for Education Research