Search Results: (1-15 of 80 records)
|REL 2022135||English Language Development Among American Indian English Learner Students in New Mexico
New Mexico’s Every Student Succeeds Act state plan set the goal for all English learner students to attain English proficiency within five years. The Regional Educational Laboratory Southwest English Learners Research Partnership conducted this study to better understand progress toward English proficiency among American Indian English learner students. The study examined two statewide cohorts of American Indian students identified as English learner students at initial kindergarten entry in 2013/14 or 2014/15 in New Mexico public schools. The study found that most American Indian English learner students were not reclassified as English proficient within five years. Similarly, most American Indian English learner students did not meet grade-level standards on New Mexico state assessments in English language arts and math in grades 3 and 4, regardless of whether they attained English proficiency and were reclassified within five years. However, considerably higher percentages of American Indian English learner students who were reclassified as English proficient met grade-level standards in both English language arts and math compared with students who were not reclassified. Finally, students who attended a school with a bilingual multicultural education program (BMEP) for at least four years were reclassified as English proficient and met grade-level standards on state assessments in English language arts and math at higher rates than students who never attended a school with a BMEP. Staff at the New Mexico Public Education Department, district and school leaders, and teachers can use the findings from this study to determine how best to support English language development among American Indian English learner students.
|REL 2022134||California’s Special Education Local Plan Areas: Funding Patterns, Inclusion Rates, and Student Outcomes
California requires each school district to belong to a Special Education Local Plan Area (SELPA) for special education planning and governance. The California Department of Education (CDE) and the State Board of Education (SBE) are interested in the impact on the surrounding small and midsized districts when large districts become single-district SELPAs. Given one of the original motivations of SELPAs was economies of scale, the state wanted to examine the association between different SELPA types and district configurations and outcomes, including SELPA funding patterns, inclusion rates of students receiving special education services in the general education environment, and academic outcomes for students receiving special education services. This study examined those differences using publicly available data. The findings provide mixed evidence for the possible implications of large districts leaving multidistrict SELPAs to form single-district SELPAs. The study found no meaningful association between different SELPA and district configurations and academic outcomes for students with disabilities—including graduation and dropout rates—and proficiency rates in math and English language arts and on the alternative assessment. Several meaningful differences with regard to funding and inclusion were found. For example, when comparing multidistrict SELPAs with and multidistrict SELPAs without a large district, multidistrict SELPAs without a large district received larger per pupil apportionments and had higher inclusion rates. Also, when comparing small districts in multidistrict SELPAs with and multidistrict SELPAs without a large district, inclusion rates were higher for preK students and lower for K–12 students in SELPAs without a large district. The larger amount of per pupil special education funding in multidistrict SELPAs without a large district may help to alleviate some concern about the impact of large districts separating from surrounding small and midsized districts to become their own SELPAs. The CDE and the SBE may want to further examine which regionalized programs are implemented by SELPAs of different compositions and how they benefit small districts. Further research could consider more complex analyses to better understand the outcomes that may be due specifically to membership in a single-district versus a multidistrict SELPA.
|REL 2022132||Career and Technical Education Credentials in Virginia High Schools: Trends in Attainment and College Enrollment Outcomes
In Virginia, there has been a long-term effort to increase the number of graduates who earn career and technical education (CTE) credentials. These CTE credentials are intended to provide high school graduates with additional preparation for college and careers. In 2013, the Virginia Board of Education added a CTE credential requirement to the Standard diploma for students who entered grade 9 for the first time in 2013 or later. Graduates can complete this requirement by passing an approved assessment and do not have to take any CTE courses.
At the request of Virginia CTE leaders, the Regional Educational Laboratory Appalachia conducted a descriptive study of attainment rates of CTE credentials, completion rates of CTE programs of study, and college enrollment rates for Standard diploma graduates from 2011 to 2017, the years before and after the policy change. Education stakeholders in Virginia and elsewhere can use the results of this study to inform their CTE policies.
From 2011 to 2017, the percentage of Standard diploma graduates who earned at least one CTE credential increased from 23 percent to 91 percent. A similar increase occurred among Advanced Studies diploma graduates, even though the CTE credential requirement applied only to Standard diploma graduates. The attainment rates of CTE credentials increased for all groups of Standard diploma graduates, including groups based on demographic characteristics, federal program participation, and academic achievement. While the percentages of Standard diploma graduates who earned a CTE credential increased consistently from 2011 to 2017, their college enrollment rates dropped. The percentage of Standard diploma graduates completing a CTE program of study, which requires taking CTE courses that are not required to earn a credential but may still be helpful for later student outcomes, decreased in 2016 and 2017.
The study findings suggest a need to examine workforce outcomes for Standard diploma graduates to fully understand whether this policy is meeting its intended goals. In addition, the findings suggest a need to consider other methods to address outcomes for Virginia’s Standard diploma graduates, such as support for implementing practices with rigorous evidence of effectiveness for improving college and career outcomes.
|REL 2022129||Principal Retention Patterns in Arizona, Nevada, and Utah
The departure of an effective school leader can influence staff turnover and student achievement for several years. With school systems facing an unprecedented public health crisis due to COVID-19, principal retention is a key area of concern for many local and state education agencies. The Regional Educational Laboratory West undertook this study of principal retention rates to help leaders in Arizona, Nevada, and Utah better understand principal retention patterns in their state, so that their new statewide leadership support initiatives could identify areas where support could be most effective. Findings showed that fewer than half of principals in each of these states remained at the same school from fall 2016 to fall 2020 (four-year retention). The study also found that principals who changed jobs (but remained in the principalship) tended to move to a new school in the same local education agency rather than to a new school in another local education agency. Principal retention patterns varied by state according to grade span, school locale type, and student demographic characteristics. In addition, across the three states, proportionally fewer principals remained at schools with lower average proficiency rates on standardized tests in math and English language arts than at schools with higher average proficiency rates from fall 2016 to fall 2019 (three-year retention).
|REL 2022131||Estimating Changes to Student Learning in Illinois Following Extended School Building Closures due to the COVID-19 Pandemic
The COVID-19 pandemic disrupted the education of students in Illinois and around the nation. Leaders at the Illinois State Board of Education and in Illinois public school districts want to better understand how student learning changed during the pandemic. This study examines data from 17 Illinois districts over five years, including four years prior to the pandemic, to measure how student learning changed in fall 2020 relative to fall terms prior to the pandemic. The study demonstrates how learning changed in both mathematics and reading for students in grades 3–8, as well as how these changes varied across student characteristics and district size. The study found that students in grades 4–8 scored lower than expected in mathematics following the onset of the pandemic, after adjusting for other factors. The magnitude varied by grade level. Larger estimated changes in learning occurred in grades 6–8 than in grades 4 and 5. Students in grades 3–8 did not experience any statistically significant changes in learning in reading. A further analysis of learning in mathematics showed that changes in learning varied across students with different characteristics but were unrelated to district size. The study findings should be interpreted with caution, especially when generalizing to the population of Illinois districts and students. The study includes a small number of districts, and the students in these districts differ from the statewide population of students.
|REL 2022109||Teacher Shortages in New York State: New Teachers' Certification Pathways, Certification Areas, District of Employment, and Retention in the Same District
New York State is experiencing teacher shortages in specific subject areas. One way to address these shortages is through the certification and placement of new teachers. This study explored the pathways through which new teachers between 2015/16 and 2017/18 earned certificates, their certification areas, and their subsequent placement and retention in districts across the state, particularly high-need districts. While the majority of new teachers earned certificates through the traditional in-state pathway, this varied somewhat by certification area. The proportion of teachers who earned certificates through the individual evaluation pathway was higher for the shortage certification area of career and technical education than for other certification areas. The most frequent certification area was the shortage certification area of special education, while the shortage certification areas of career and technical education and bilingual special education were among the least frequent. New York City district schools employed new teachers who earned certificates through the alternative in-state pathway at a higher rate than other types of high-need districts (rural, large city—not New York City, and other urban/suburban) as well as average- and low-need districts. New teachers employed in high-need districts had higher rates of retention in the same district for a second year than new teachers employed in average- and low-need districts. Just 5 percent of new teachers in New York State were uncertified.
|REL 2022110||Additional Certification for Teachers in New York State: Teachers’ Experience and Employment Location, Certification Pathways, and Certification Areas
New York State is experiencing teacher shortages in specific subject areas. One way to address these shortages is for certified teachers to earn additional certificates qualifying them to fill positions in shortage areas. This study explored patterns in how experienced teachers (those with at least one year of teaching experience in New York State public schools) in 2015/16 earned additional certificates between October 2015 and October 2017. These patterns included which teachers earned additional certificates, their certification pathways, and their additional certification areas. The study found that about 5 percent of teachers in New York State in 2015/16 earned additional certificates during the two-year period. A larger proportion of teachers who earned additional certificates during that period were employed in New York City district schools and charter schools than in other types of districts or schools. Teachers who earned additional certificates were less experienced than those who did not earn additional certificates. More teachers earned additional certificates in shortage areas than in nonshortage areas, except for administration, a nonteaching certification area. Special education was the most common shortage certification area in which experienced teachers earned additional certificates. More than half of teachers who earned additional certificates did so through the traditional in-state pathway, while about a third did so through the individual evaluation pathway.
|REL 2022127||Education and Career Planning in High School: A National Study of School and Student Characteristics and College-Going Behaviors
A large proportion of high schools across the country have adopted education and career planning requirements intended to help students prepare for postsecondary education and to facilitate successful transitions to the labor market. This study used student and counselor survey responses from a nationally representative longitudinal dataset to examine the relationships between students’ participation in three core elements of education and career planning during high school and their application, coursetaking, and enrollment behaviors associated with the transition to college. Students who developed an education or career plan upon first entering high school in grade 9 were no more or less likely to submit the Free Application for Federal Student Aid, complete a college preparatory curriculum, apply to college, or enroll in college than students who did not develop a plan. However, for students who received support from a teacher or a parent to develop their plan and for students who met with an adult in school to review the plan at least once a year, developing a plan was significantly associated with several college-going behaviors.
|REL 2022130||Exploring Early Implementation of Pennsylvania's Innovative Teacher and Principal Residency Grants
To improve educator diversity and address educator shortages, the Pennsylvania Department of Education (PDE) awards grants to universities in the state to develop and implement teacher and principal residency preparation programs. The programs must offer aspiring teachers and principals a residency of at least a year, consisting of clinical practice in schools with trained mentors, aligned coursework, and financial aid. The programs must focus on improving diversity and must partner with districts with chronic teacher or principal shortages, high proportions of students of color or in poverty, or that have been identified for state support.
This study examines eight residency programs that received grants for the 2019/20 school year. The study interviewed program staff, collected program data, and conducted focus groups with residents and mentors. The study sought to provide preliminary information early in the implementation of the programs on how well they were preparing teachers and principals, where the teachers and principals were getting jobs after completing the programs, whether the programs were improving diversity, and how they could be improved.
Four key findings emerged from the study. First, recruiting diverse candidates was difficult. Teacher residents were mostly White, although more than a third of participants in one of the programs were people of color. Principal residents were more diverse. Second, for five of the six programs with available employment data, at least half of the residents were hired in high-need districts after completing the programs. Third, residents and mentors felt the residents were prepared for most teaching or school leadership responsibilities, although principal mentors felt some principal residents were not as well prepared. Finally, program staff, residents, and mentors described several lessons learned, including that communication and the balance of the time commitment between the coursework and the residency could be improved.
The findings will inform PDE’s plans for future grants and help the funded programs improve. The findings may also be relevant to other states, districts, or preparation programs that are developing residency programs.
|REL 2022123||Academic Mindsets and Behaviors, Prior Achievement, and the Transition to Middle School
Middle school is an important crossroad in a student’s academic journey. As students enter middle school, their academic achievement and engagement frequently declines. This is true particularly for Black and Latinx students. Poor middle school grades are often a harbinger of poor performance in high school and beyond. In particular, having a grade point average (GPA) below 2.0 is a strong signal of continuing negative academic outcomes. Previous research has found that academic outcomes around the transition to middle school are related to, and might even be driven by, academic mindsets, including growth mindsets (such as beliefs about the malleability of academic ability and the payoff to effort) and performance avoidance (fears of failure and the desire to avoid academic effort), and resulting academic behaviors (such as completing homework).
This study examined the relationship between 2016/17 grade 5 student responses to a Clark County School District (Nevada) survey on levels of academic mindsets and behaviors and the predicted probability of earning a low GPA (below 2.0) at the end of the first semester of grade 6 (the first year of middle school) in 2017/18. Grade 5 students who reported high levels of growth mindset and academic behavior and low levels of performance avoidance had a lower predicted probability of having a GPA below 2.0 in the first semester of grade 6. Once student scores on grade 5 state standardized math and English language arts achievement exams were accounted for, levels of academic mindsets and behaviors among grade 5 students with scores at or above the district median did not predict meaningful differences in the probability of having a GPA below 2.0 in the first semester of grade 6. However, among grade 5 students with prior academic achievement below the district median, students who reported high levels of growth mindset and academic behaviors and low levels of performance avoidance had a lower predicted probability of having a GPA below 2.0 in the first semester of grade 6, even after differences in individual grade 5 prior academic achievement were accounted for. These patterns were essentially the same for all racial/ethnic groups as well as for both English learner students and non–English learner students.
|REL 2022125||Schools' Experiences with Georgia's District and School Flexibility Policy
Georgia instituted a flexibility policy in 2007 that provided districts with waivers from state education rules, provisions, and guidelines. In exchange, schools must meet academic performance targets. The performance contracts are meant to encourage schools and districts to implement innovative practices to increase achievement for all students in Georgia. Between 2008/09 and 2016/17, 178 of Georgia’s 180 districts entered into performance contracts with the state. The Georgia Department of Education (GaDOE) asked Regional Educational Laboratory Southeast to analyze how each school’s achievement changed after the start of their district’s performance contracts and the factors related to those changes. GaDOE also requested information on schools’ implementation of and experiences with the state’s flexibility policy, focusing on how schools have prioritized local innovations in practice. Overall, the study found positive but small changes in achievement for grades 3–8 English language arts and math and found significant variation in changes in achievement across schools within districts, after adjusting for other factors. Changes in achievement after performance contracts were implemented were related to schools’ demographic composition and prior achievement. In response to a survey, school leaders reported prioritizing innovations related to use of data to identify early intervention needs, formative assessments used to guide instruction, supplemental programs for low-performing students, and personalized learning for students. Leaders in schools with larger proportions of students eligible for the national school lunch program, Black students, and English learner students reported prioritizing innovations related to online and/or blended curricula more frequently than schools with smaller proportions of these students. School leaders also reported a great deal of school-level influence over decisions about priority innovations.
|REL 2022124||Predicting Early Fall Student Enrollment in the School District of Philadelphia
Predicting incoming enrollment is an ongoing concern for the School District of Philadelphia (SDP) and similar districts with school choice systems, substantial student mobility, or both. Inaccurate predictions can disrupt learning as districts adjust to enrollment fluctuations by reshuffling teachers and students well into the fall semester. This study compared the accuracy of four statistical techniques for predicting fall enrollment at the school-by-grade level, using data from prior years, to assess which approach might be the most useful for planning school staffing in SDP. The predictions differ little in accuracy: predicted cohort size differs from actual cohort size by roughly six students across all methods The statistical techniques leave much student mobility unaccounted for. Even under the best prediction approach, students and teachers in 22 percent of incoming grade levels within schools might have to be reassigned because of unexpected student mobility and district rules on maximum class size. Predictive accuracy is not meaningfully different in schools with larger proportions of Black students, economically disadvantaged students, or English learner students. Of the 259 predictors analyzed, 4 stand out as the most important: prior cohort sizes, in-school suspensions, out-of-school suspensions, and absences.
|REL 2021226||Identifying Students At Risk Using Prior Performance Versus a Machine Learning Algorithm
This report provides information for administrators in local education agencies who are considering early warning systems to identify at-risk students. Districts use early warning systems to target resources to the most at-risk students and intervene before students drop out. Schools want to ensure the early warning system accurately identifies the students that need support to make the best use of available resources. The report compares the accuracy of using simple flags based on prior academic problems in school (prior performance early warning system) to an algorithm using a range of in- and out-of-school data to estimate the specific risk of each academic problem for each student in each quarter. Schools can use one or more risk-score cutoffs from the algorithm to create low- and high-risk groups. This study compares a prior performance early warning system to two risk-score cutoff options: a cutoff that identifies the same percentage of students as the prior performance early warning system, and a cutoff that identifies the 10 percent of students most at risk.
The study finds that the prior performance early warning system and the algorithm using the same-percentage risk score cutoffs are similarly accurate. Both approaches successfully identify most of the students who ultimately are chronically absent, have a low grade point average, or fail a course. In contrast, the algorithm with 10-percent cutoffs is good at targeting the students who are most likely to experience an academic problem; this approach has the advantage in predicting suspensions, which are rarer and harder to predict than the other outcomes. Both the prior performance flags and the algorithm are less accurate when predicting outcomes for students who are Black.
The findings suggest clear tradeoffs between the options. The prior performance early warning system is just as accurate as the algorithm for some purposes and is cheaper and easier to set up, but it does not provide fine-grained information that could be used to identify the students who are at greatest risk. The algorithm can distinguish degrees of risk among students, enabling a district to set cutoffs that vary depending on the prevalence of different outcomes, the harms of over-identifying versus under-identifying students at risk, and the resources available to support interventions.
|REL 2021118||Variations in District Strategies for Remote Learning During the COVID-19 Pandemic
In spring 2020, the COVID-19 pandemic led to an unprecedented and abrupt stoppage of in-person learning in schools across the country. State education agency leaders in Kansas, Nebraska, North Dakota, and Wyoming needed information on proposed strategies in districts’ remote learning plans to ensure continuity and better support remote learning in their states. This study used document analysis to examine proposed strategies related to infrastructure; strategies and supports for instruction; and supports for teachers, students, and parents. Findings are presented separately by district Internet connectivity level, district poverty quartile, and district locale. These findings represent variations in district remote learning plans across the four states included in the study.
The study found that proposed remote learning strategies varied considerably and were often related to district characteristics. For instance, a higher percentage of districts with higher Internet connectivity before the pandemic proposed support for home-based Internet; full student access to devices; technology support; and additional supports for teachers, students, and parents. In addition, a higher percentage of nonrural districts and high-poverty districts proposed supports for students and parents, such as one-on-one meetings between students and teachers and resources for parents on remote learning.
Although district capacity to implement remote learning has likely improved since the start of the pandemic, state education agency leaders can use the findings in this report to consider providing more support to districts with persistent Internet connectivity challenges. Leaders can also use the report to inform additional data collection to examine how remote learning strategies have evolved and to help determine the implications of the shift on student learning.
|REL 2021116||Factors Associated with Grade 3 Reading Outcomes of Students in the Commonwealth of the Northern Mariana Islands Public School System
Few elementary students on the Commonwealth of the Northern Mariana Islands (CNMI) are scoring at grade level or higher on the ACT Aspire reading assessment. To better understand factors associated with the reading proficiency of CNMI grade 3 students, stakeholders there asked the Regional Educational Laboratory Pacific to examine the demographic characteristics and education experiences of students who demonstrated reading proficiency by grade 3. The study focused on grade 3 students who were enrolled in CNMI public schools from 2014/15 to 2018/19. It found that female students, students who did not receive free or reduced-priced lunch, students who were older at the time of kindergarten entry, Filipino students, and students who did not change schools were more likely to demonstrate reading proficiency in grade 3 than other students. There was no difference in grade 3 reading proficiency between students who had enrolled in Head Start and students who had not.