Publications & ProductsSearch Results: (1-10 of 10 records)
| Pub Number | Title |  Date |
|---|---|---|
| REL 2016111 | Measuring school leaders' effectiveness: Findings from a multiyear pilot of Pennsylvania's Framework for Leadership
This "Stated Briefly" report is a companion piece that summarizes the results of another report of the same name. This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed four key properties of the FFL: score variation, internal consistency, year-to-year stability, and concurrent validity. Score variation was characterized by the percentages of school leaders earning scores in different portions of the rating scale. To measure the internal consistency of the FFL, Cronbach's alpha was calculated for the full FFL and for each of its four categories of leadership practices. Analyses of score stability used data on FFL scores of school years across two years to calculate Pearson’s correlation coefficient. Concurrent validity was assessed through a regression model for the relationship between school leaders' estimated contributions to student achievement growth and their FFL scores. This report is based primarily on the 2013/14 pilot in which 517 principals and 123 assistant principals were rated by their supervisors; an interim report examined data from the 2012/13 pilot year. The study finds that the FFL is a reliable measure, with good internal consistency and a moderate level of year-to-year stability in scores. The study also finds evidence of the FFL’s concurrent validity: principals with higher scores on the FFL, on average, make larger estimated contributions to student achievement growth. Higher total FFL scores and scores in two of the four FFL domains are significantly or marginally significantly associated with both value-added in all subjects combined and value-added in math specifically. This evidence of the validity of the FFL sets it apart from other principal evaluation tools: No other measures of principals' professional practice have been shown to be related to principals' effects on student achievement. However, in both pilot years, variation in scores was limited, with most school leaders scoring in the upper third of the rating scale. As the FFL is implemented statewide, continued examination of evidence on its statistical properties, especially the variation in scores, is important. |
1/21/2016 |
| REL 2016106 | Measuring school leaders' effectiveness: Final report from a multiyear pilot of Pennsylvania's Framework for Leadership
This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed four key properties of the FFL: score variation, internal consistency, year-to-year stability, and concurrent validity. Score variation was characterized by the percentages of school leaders earning scores in different portions of the rating scale. To measure the internal consistency of the FFL, Cronbach's alpha was calculated for the full FFL and for each of its four categories of leadership practices. Analyses of score stability used data on FFL scores of school years across two years to calculate Pearson’s correlation coefficient. Concurrent validity was assessed through a regression model for the relationship between school leaders' estimated contributions to student achievement growth and their FFL scores. This report is based primarily on the 2013/14 pilot in which 517 principals and 123 assistant principals were rated by their supervisors; an interim report examined data from the 2012/13 pilot year. The study finds that the FFL is a reliable measure, with good internal consistency and a moderate level of year-to-year stability in scores. The study also finds evidence of the FFL's concurrent validity: principals with higher scores on the FFL, on average, make larger estimated contributions to student achievement growth. Higher total FFL scores and scores in two of the four FFL domains are significantly or marginally significantly associated with both value-added in all subjects combined and value-added in math specifically. This evidence of the validity of the FFL sets it apart from other principal evaluation tools: No other measures of principals' professional practice have been shown to be related to principals' effects on student achievement. However, in both pilot years, variation in scores was limited, with most school leaders scoring in the upper third of the rating scale. As the FFL is implemented statewide, continued examination of evidence on its statistical properties, especially the variation in scores, is important. |
1/21/2016 |
| REL 2015089 | Measuring principals' effectiveness: Results from New Jersey's principal evaluation pilot
The purpose of this study was to describe the measures used to evaluate principals in New Jersey in the first (pilot) year of the new principal evaluation system and examine three of the statistical properties of the measures: their variation among principals, their year-to-year stability, and the associations between these measures and the characteristics of students in the schools. The study reviewed information that developers of principal practice instruments provided about their instruments and examined principals' performance ratings using data from 14 districts in New Jersey that piloted the principal evaluation system in the 2012/13 school year. The study had four key findings: First, the developers of principal practice instruments provided partial information about their instruments' reliability (consistency across raters and observations) and validity (accurate measurement of true principal performance). Second, principal practice ratings and schoolwide student growth percentiles have the potential to differentiate among principals. Third, school median student growth percentiles, which measure student achievement growth during the school year, exhibit year-to-year stability even when the school changes principals. This may reflect persistent school characteristics, suggesting a need to investigate whether other evaluation measures could more closely gauge principals' contributions to student achievement growth. Finally, school median student growth percentiles correlate with student disadvantage, a relationship that warrants further investigation using statewide evaluation data. Results show a mix of strengths and weaknesses in the statistical properties of the measures used to evaluate principals in New Jersey. Future research could provide more evidence on the accuracy of measures used to evaluate principals. |
5/12/2015 |
| REL 2015068 | A Descriptive Analysis of the Principal Workforce in Florida Schools
This report describes the results of a REL Southeast study using the Florida Department of Education staffing database to describe the demographic make-up, Florida Educator Certificate coverages, career paths from 2001/02 to 2011/12, and evaluation ratings of Florida's educational leaders (i.e., assistant principals and principals) in the 2011/12 school year. The sample consisted of 4273 assistant principals and 2979 principals. The study consists of a cross-sectional component and a longitudinal component. The cross-sectional component analyzed the demographic characteristics of the 2011/12 school year educational leaders. The longitudinal component utilized a retrospective cohort analysis to track the certification coverages and career paths of the educational leaders from 2001/02 to 2011/12. Analyses of frequencies, measures of central tendency and distribution, and cross tabulations were examined to provide insight into the demographic characteristics, training, professional experiences, performance, and career paths of Florida's educational leaders in the 2011/12 school year. |
3/24/2015 |
| NCES 2014356 | 2011-12 Schools and Staffing Survey (SASS) Restricted-Use Data Files
This DVD contains the 2011-2012 Schools and Staffing Survey (SASS) restricted-use data files. The 8 files (Public School District, Public School Principal, Public School, Public School Teacher, Public School Library Media Center, Private School Principal, Private School, and Private School Teacher) are provided in multiple formats. The DVD also contains a 6-volume User's Manual, which includes a codebook for each file. |
11/6/2013 |
| NCES 2010363 | 2007-08 Schools and Staffing Survey (SASS) and 2008-09 Teacher Follow-up Survey (TFS) (CD ROM) Restricted-Use Data with Codebook
The restricted-use codebook contains the count of responses for each data item and all components of SASS in 2007-2008 and the 2008-2009 TFS. The TFS data and User's manual are the added features to this re-release of the 2007-2008 SASS restricted-use ECB. |
9/7/2010 |
| NCES 2008309 | 2003-04 Schools and Staffing Survey (SASS) and 2004-05 Teacher Follow-up Survey (TFS) (CD ROM) Restricted-Use Data with Electronic Codebook
The restricted-use codebook contains the count of responses for each data item and all components of SASS in 2003-2004 and the 2004-2005 TFS. The TFS data and User's manual are the added features to this re-release of the 2003-2004 SASS restricted-use ECB. |
10/31/2007 |
| NCES 2005335 | 1999-2000 Schools and Staffing Survey (SASS) and 2000-01 Teacher Follow-up Survey (TFS) CD-ROM: Public-Use Data with Electronic Codebook
This updated public-use electronic codebook contains frequency counts of responses for each data item and most respondents from the 2000-01 Teacher Follow-up Survey, in addition to the previously released 1999-2000 SASS data. Copies of the 1999-2000 SASS questionnaires are available at: http://nces.ed.gov/surveys/SASS/question9900.asp; see the Online Availability for the TFS questionnaires. |
4/1/2005 |
| NCES 97455 | Public and Private School Principals in the United States: A Statistical Profile, 1987-88 to 1993-94
This report uses data from the 1987-88, 1990-91, and 1993-94 adminisrations of SASS to examine the principalship in the reform environment of the late 1980s and early 1990s. For each of those years, approximately 80,000 principals served in the nation's public schools and approximately 25,000 served in private schools. |
6/12/1997 |
| NCES 97591 | Issue Brief: Programs for Aspiring Principals: Which Principals Participated? (Issue Brief)
This brief presents the percentages of public school principals--overall, by sex and minority status, and by school locale and level--who reported having taken part in such programs. In addition, to assess whether participation in these types of school and district programs has increased in recent years, this brief compares the participation rates of new principals (i.e., principals with fewer than 4 years of experience) with the participation rates of more experienced principals (i.e., principals with 4 or more years of experience). |
3/17/1997 |
1 - 10
