Search Results: (1-9 of 9 records)
|NCSER 2015002||The Role of Effect Size in Conducting, Interpreting, and Summarizing Single-Case Research
The field of education is increasingly committed to adopting evidence-based practices. Although randomized experimental designs provide strong evidence of the causal effects of interventions, they are not always feasible. For example, depending upon the research question, it may be difficult for researchers to find the number of children necessary for such research designs (e.g., to answer questions about impacts for children with low-incidence disabilities). A type of experimental design that is well suited for such low-incidence populations is the single-case design (SCD). These designs involve observations of a single case (e.g., a child or a classroom) over time in the absence and presence of an experimenter-controlled treatment manipulation to determine whether the outcome is systematically related to the treatment.
Research using SCD is often omitted from reviews of whether evidence-based practices work because there has not been a common metric to gauge effects as there is in group design research. To address this issue, the National Center for Education Research (NCER) and National Center for Special Education Research (NCSER) commissioned a paper by leading experts in methodology and SCD. Authors William Shadish, Larry Hedges, Robert Horner, and Samuel Odom contend that the best way to ensure that SCD research is accessible and informs policy decisions is to use good standardized effect size measures—indices that put results on a scale with the same meaning across studies—for statistical analyses. Included in this paper are the authors' recommendations for how SCD researchers can calculate and report on standardized between-case effect sizes, the way in these effect sizes can be used for various audiences (including policymakers) to interpret findings, and how they can be used across studies to summarize the evidence base for education practices.
|NCER 20162000||A Compendium of Math and Science Research Funded by NCER and NCSER: 2002–2013
Between 2002 and 2013, the Institute of Education Sciences (Institute) funded over 300 projects focused on math and science through the National Center for Education Research (NCER) and the National Center for Special Education Research (NCSER). Together, researchers funded by NCER and NCSER have developed or tested more than 215 instructional interventions (e.g., packaged curricula, intervention frameworks, and instructional approaches), 75 professional development programs, 165 educational technologies, and 65 assessments in math and science. NCER commissioned the development of this compendium with the intent to present information in a structured, accessible, and usable manner. This compendium organizes information on the NCER and NCSER projects into two main sections: Mathematics and Science. Within each section, projects are sorted into chapters based on content area, grade level, and intended outcome. The compendium also includes multiple appendices and an index to help readers locate specific types of information (e.g., projects that focus on English language learners, specific interventions).
|NCER 20142000||Partially Nested Randomized Controlled Trials in Education Research: A Guide to Design and Analysis
In some tests of educational interventions, individual students are randomized directly to the treatment or control group, and both intervention and control protocols are administered in an individual setting. Such an experiment is an Individual-Level Randomized Controlled Trial (I-RCT). In other tests, clusters of students (e.g., classrooms) are randomized. This sort of experiment is called a Cluster Randomized Controlled Trial (C-RCT). However, in some designs, students in the treatment group are clustered like those in a C-RCT, but students in the control group are unclustered, like students in an I-RCT. This design is called a Partially Nested Randomized Controlled Trial (PN-RCT). It is partially nested because students in the treatment group are nested in some higher level unit, such as a tutoring group or class, but students in the control group are not nested as part of the experimental design.
This paper, commissioned by the National Center for Education Research, provides readers with an introduction to PN-RCTs and ways to design and analyze the results from them. This paper was written primarily for applied education researchers with introductory knowledge of quantitative impact evaluation methods. However, those with more advanced knowledge will also benefit from some of the technical examples and appendices.
|NCER 2013PUBS||National Center for Education Research Publication Handbook: Publications from funded education research grants FY 2002 to FY 2013 November
Since its inception in 2002, the National Center for Education Research (NCER) in the Institute of Education Sciences (IES) has funded over 700 education research grants and over 60 education training grants. The research grants have supported have supported exploratory research to build theory or generate hypotheses on factors that may affect educational outcomes, development and innovation research to create or refine academic interventions, evaluation studies to test the efficacy and effectiveness of interventions, and measurement work to help develop more accurate and valid assessments, and the training grants have helped prepare the next generation of education researchers. NCER‘s education research grantees have focused on the needs of a wide range of students, from pre-kindergarten through postsecondary and adult education, and have tackled a variety of topic areas. The portfolio of research includes cognition, social and behavioral research, math, science, reading, writing, school systems and policies, teacher quality, statistical and research methods, just to name a few.
Each year, our grantees are contributing to the wealth of knowledge across disciplines. What follows is a listing of the publications that these grants have contributed along with a full listing of all the projects funded through NCER's education research grant programs from 2002 to 2013. The publications are presented according to the topic area and arranged by the year that the grant was awarded. Where applicable, we have noted related grant projects and project websites and have provided links to publications that are listed in the IES ERIC database. For grants that do not yet have associated publications in press or published, we include the word Publications as a placeholder to denote where future publications will occur during updates to this document.
|NCER 20112001||Efficacy of Schoolwide Programs to Promote Social and Character Development and Reduce Problem Behavior in Elementary School Children
The report, Efficacy of Schoolwide Programs to Promote Social and Character Development and Reduce Problem Behavior in Elementary School Children (NCER 2011-2001), provides the results from the evaluation of the seven SACD programs carried out by MPR. The report includes three key findings: 1) the seven SACD programs increased the reported implementation of classroom activities intended to increase students' social and character development, 2) the control schools also reported the use of a variety of activities intended to increase students' social and character development as "standard practice" but not at the same levels as the treatment schools, and 3) there were no differences in students' social and emotional competence, behaviors, academic performance, or perceptions of school climate between students in schools implementing one of the seven SACD programs and those in the control schools.
|NCER 20082009REV||Effects of Preschool Curriculum Programs on School Readiness: Report from the Preschool Curriculum Evaluation Research Initiative
In 2002, the Institute of Education Sciences (IES) began the Preschool Curriculum Evaluation Research (PCER) initiative to conduct rigorous efficacy evaluations of available preschool curricula. Twelve research teams implemented one or two curricula in preschool settings serving predominantly low-income children under an experimental design. For each team, preschools or classrooms were randomly assigned to the intervention curricula or control curricula and the children were followed from pre-kindergarten through kindergarten. IES contracted with RTI International (RTI) and Mathematica Policy Research (MPR) to evaluate the impact of each of the 14 curricula implemented using a common set of measures with the cohort of children beginning preschool in the summer-fall of 2003.
This report provides the individual results for each curriculum from the evaluations by RTI and MPR. Chapter 1 describes the PCER initiative and details the common elements of the evaluations including the experimental design, implementation, analysis, results, and findings. Chapters 2-13, respectively, provide greater detail on the individual evaluations of the curricula implemented by each research team including information on the curricula, the demographics of the site-specific samples, assignment, fidelity of implementation, and results. Appendix A presents results from a secondary analysis of the data. Appendix B provides greater detail regarding the data analyses conducted. Appendixes C and D provide additional information regarding the outcome measures.
|NCER 20072003||Encouraging Girls in Math and Science: IES Practice Guide
This NCER Practice Guide is the second in a series of IES guides in education. Developed by a panel of experts, this guide brings together the best available evidence and expertise to provide educators with specific and coherent evidence-based recommendations on how to encourage girls in the fields of math and science. The objective is to provide teachers with specific recommendations that can be carried out in the classroom without requiring systemic change. Other school personnel having direct contact with students, such as coaches, counselors, and principals may also find the guide useful. The guide offers five recommendations and indicates the quality of the evidence that supports the recommendations. Together, the recommendations make a coherent statement: To encourage girls in math and science, educators need to strengthen girls' beliefs about their abilities in math and science, spark and maintain greater interest in these subject areas, and build associated skills.
|NCER 20072004||Organizing Instruction and Study to Improve Student Learning
This NCER Practice Guide is the third in a series of IES guides in education. This guide reflects an expert panel's consensus on some of the most important principles to emerge from research on learning and memory. The guide draws on the best available evidence and expertise to provide teachers with specific strategies for organizing instruction and students' studying of material to facilitate learning and remembering, and for helping students use what they have learned in new situations. The guide includes a set of concrete actions relating to the use of instructional and study time that are applicable to subjects that demand a great deal of content learning, including social studies, science, and mathematics. Along with seven recommendations for teachers, the panel also indicates the quality of evidence that supports each recommendation.
|IES 20076004||IES 2007 Biennial Report to Congress
The Institute of Education Sciences has issued the Director's Biennial Report to Congress, covering activities and accomplishments of the Institute in 2005 and 2006.
Transmitted by Director Grover J. (Russ) Whitehurst as required by the Education Sciences Reform Act of 2002, the report includes a description of the activities of IES and its four National Education Centers, as well as a summary of all IES grants and contracts during the biennium in excess of $100,000.
Since IES's first Biennial Report two years ago, said Whitehurst, "IES has been transformed from an organization under construction to one that is fully formed and operational."