IES Blog

What is the Common Core of Data?

Every year, the National Center for Education Statistics (NCES) releases nonfiscal data files from the Common Core of Data (CCD), one of the U.S. Department of Education’s (ED’s) primary resources on public elementary and secondary school districts, schools, and students. CCD nonfiscal data are made available to the public as data files, as well as in user-friendly data tools, and include the district and school directory (location, operational status, and grades offered) as well as data on student membership (by grade, sex, and race/ethnicity), full-time equivalent staff and teachers, and the number of students eligible for the National School Lunch Program (NSLP). 

Why is CCD so important?

The CCD is a trusted data source used by ED stakeholders, researchers, and the public. Timely release of high-quality, accurate CCD data is critical not only to these stakeholders but also to ED’s commitment to providing high-quality data products. 

CCD data are now released within months of submission by states!

Over the past several years, NCES made process improvements to the collection and dissemination of CCD data (described below) that allow NCES to release the CCD data more quickly than ever before. As a result of these changes, the school year (SY) 2023-24 CCD data files will be available to the public less than 4 months after the July 2024 submission due date.

In contrast, the SY 2016-17 CCD data files were due in May 2017 and released January 2019 (a full 20 months later).

What has NCES done to release HIGH-QUALITY CCD nonfiscal data so quickly?

NCES modernized the CCD nonfiscal data quality (DQ) review and file production process in two phases:

Phase 1: Modernized CCD DQ review and file production. Defined the DQ standard through business rules, held state data providers to the defined DQ standard, developed a system to provide DQ feedback to states within a few days of submission, and improved the public file format.

This CCD data quality system developed in Phase 1 served as a sandbox for the broader EDFacts modernization project, called EDPass. EDPass is a centralized data submission system used by ED to standardize data submissions across ED offices. 

Phase 2: Full modernization of data submissions with EDPass. NCES manages the EDPass data submission tool for use by ED stakeholders including NCES, the Office of Elementary and Secondary Education (OESE), and the Office of Special Education Programs (OSEP). The new submission tool, rolled out with the SY 2022-23 collection cycle, eliminated the time-consuming post-submission DQ process by running DQ checks at upload and requiring states to address all data quality issues prior to data submission. Critical components of this successful implementation included:

• Clear message from ED that high-quality data are expected at the due date
  • NCES communicated the change in the submission process to state CCD Coordinators 2 years in advance
  • Due dates were shifted to accommodate pre-submission DQ checks and to give states more time to get accustomed to the new process
  • ED set due dates and held states accountable for the quality of the data; poor- quality data were suppressed and late data submissions were not included in data releases
• Investments in people and technology
  • NCES’s new EDPass submission system is user-friendly
  • NCES CCD staff and contractors increased direct support to states during data collection through well-attended office hour sessions
• Improved data quality process
  • NCES published the full catalog of standardized business rules that align with data file specifications
  • States receive data quality results within minutes of a file upload
  • EDPass system does not allow states to submit any uploaded data files until all identified DQ issues are addressed
• Enhanced DQ reports
  • All DQ results are available for ED stakeholder use immediately after the collection due date
  • Data notes that accompany file releases provide state explanations for identified DQ issues and are built directly from state comments provided during data submission
• State buy-in
  • State data submitters contributed feedback on the new system and processes during development
  • States made systematic internal data governance improvements in response to EDPass modernization and the improved data quality process

Conclusions

As demonstrated by the SY 2023-24 CCD data release, ED’s bold investment in EDPass technology and end-to-end process changes allow for the release of high-quality, consistent data products more quickly than ever. The benefits from this investment, however, reach beyond data products, resulting in significant burden reductions both for states and for ED program offices that use the data. EDPass modernization also supports compliance with the Information Quality Act, the ED-wide Data Strategy effort to improve data access and advance the strategic use of data and, more broadly, ED’s efforts to comply with the November 2023 Office of Inspector General Management Challenges report.  

Finally, while the gains from the EDPass modernization are illustrated in this blog through the SY 2023-24 CCD nonfiscal data release, this modernization impacts ALL data collected through the EDFacts submission system and will enable earlier release of high-quality data by other program offices, including OESE through ED Data Express and OSEP through ED’s Open Data Platform.  

This year marks the 20th anniversary of the Institute of Education Sciences (IES) and 155 years since the creation of a federal agency to collect and report education statistics for the United States, a role now fulfilled by the National Center for Education Statistics (NCES). To celebrate both of these anniversaries, NCES has just released a new commemorative report—A Retrospective Look at U.S. Education Statistics—that explores the history and use of federal education statistics.

The 11 statistical profiles in phase I of this report can be found within two tabs: Elementary and Secondary Education and Postsecondary Education. Users can toggle between these two tabs and then select a particular statistical profile in the drop-down menu, such as Number of Elementary and Secondary Schools, High School Coursetaking, Enrollment in Postsecondary Institutions, and Postsecondary Student Costs and Financing.

Each of the statistical profiles in this report is broken down into the following sections:

• what the statistic measures (what the data may indicate about a particular topic)
• what to know about the statistic (the history of the data collection and how it may have changed over time)
• what the data reveal (broad historical trends/patterns in the data, accompanied by figures)
• more information (reference tables and related resources)

Each statistical profile can be downloaded as a PDF, and each figure within a profile can be downloaded or shared via a link or on social media.

For background and context, this report also includes a Historical Event Timeline. In this section, readers can learn about major periods of prolonged economic downturn, periods of military action, and periods when U.S. troops were drafted as a part of military action—as well as major pieces of federal legislation—and how some of these events could have disrupted the nation’s social life and schooling or impacted education across the country.

The report also includes a brief overview of NCES, which can be accessed by expanding the dark blue bar labeled NCES Overview: Past, Present, and Future. This section covers the history of NCES and its mission, the evolution of NCES reports and data collections, and current and future changes to NCES’s reporting methods.

This commemorative guide to federal education statistics is not intended to be a comprehensive report on the subject but rather a resource that provides an in-depth look at a selection of statistics. Stay tuned for the release of phase II next year, which will include additional statistical profiles. Be sure to follow NCES on Twitter, Facebook, LinkedIn, and YouTube and subscribe to the NCES News Flash to stay up-to-date!

By Megan Barnett, AIR

The Integrated Postsecondary Education Data System (IPEDS) is a comprehensive federal data source that collects information on key features of higher education in the United States, including characteristics of postsecondary institutions, college student enrollment and academic outcomes, and institutions’ employees and finances, among other topics.

The National Center for Education Statistics (NCES) has created a new resource page, Student Cohorts and Subgroups in IPEDS, that provides data reporters and users an overview of how IPEDS collects information related to postsecondary students and staff. This blog post highlights key takeaways from the resource page.

IPEDS survey components collect counts of key student and staff subgroups of interest to the higher education community.

Data users—including researchers, policy analysts, and prospective college students—may be interested in particular demographic groups within U.S. higher education. IPEDS captures data on a range of student and staff subgroups, including race/ethnicity, gender, age categories, Federal Pell Grant recipient status, transfer-in status, and part-time enrollment status.

The Outcome Measures (OM) survey component stands out as an example of how IPEDS collects student subgroups that are of interest to the higher education community. Within this survey component, all entering degree/certificate-seeking undergraduates are divided into one of eight subgroups by entering status (i.e., first-time or non-first-time), attendance status (i.e., full-time or part-time), and Pell Grant recipient status.

Although IPEDS is not a student-level data system, many of its survey components collect counts of students and staff by subgroup.

Many IPEDS survey components—such as Admissions, Fall Enrollment, and Human Resources—collect data as counts of individuals (i.e., students or staff) by subgroup (e.g., race/ethnicity, gender) (exhibit 1). Other IPEDS survey components—such as Graduation Rates, Graduation Rates 200%, and Outcome Measures—also include selected student subgroups but monitor cohorts of entering degree/certificate-seeking students over time to document their long-term completion and enrollment outcomes. A cohort is a specific group of students established for tracking purposes. The cohort year is based on the year that a cohort of students begins attending college.

Exhibit 1. IPEDS survey components that collect counts of individuals by subgroup

IPEDS collects student and staff counts by combinations of interacting subgroups.

For survey components that collect student or staff counts, individuals are often reported in disaggregated demographic groups, which allows for more detailed understanding of specific subpopulations. For example, the Fall Enrollment (EF) and 12-month Enrollment (E12) survey components collect total undergraduate enrollment counts disaggregated by all possible combinations of students’ full- or part-time status, gender, degree/certificate-seeking status, and race/ethnicity. Exhibit 2 provides an excerpt of the EF survey component’s primary data collection screen (Part A), in which data reporters provide counts of students who fall within each demographic group indicated by the blank cells.

Exhibit 2. Excerpt of IPEDS Fall Enrollment (EF) survey component data collection screen for full-time undergraduate men: 2022­–23

[click image to enlarge]

NOTE: This exhibit reflects the primary data collection screen (Part A) for the 2022–23 Fall Enrollment (EF) survey component for full-time undergraduate men. This screen is duplicated three more times for undergraduate students, once each for part-time men, full-time women, and part-time women. For survey materials for all 12 IPEDS survey components, including complete data collection forms and detailed reporting instructions, visit the IPEDS Survey Materials website.

As IPEDS does not collect data at the individual student level, these combinations of interacting subgroups are the smallest unit of information available in IPEDS. However, data users may wish to aggregate these smaller subgroups to arrive at larger groups that reflect broader populations of interest.

For example, using the information presented in exhibit 2, a data user could sum all the values highlighted in the green column to arrive at the total enrollment count of full-time, first-time men. As another example, a data user could sum all the values highlighted in the blue row to determine the total enrollment count of full-time Hispanic/Latino men. Note, however, that many IPEDS data products provide precalculated aggregated values (e.g., total undergraduate enrollment), but data are collected at these smaller units of information (i.e., disaggregated subgroup categories).

Student enrollment counts and cohorts align across IPEDS survey components.

There are several instances when student enrollment or cohort counts reported in one survey component should match or very closely mirror those same counts reported in another survey component. For example, the number of first-time degree/certificate-seeking undergraduate students in a particular fall term should be consistently reported in the Admissions (ADM) and Fall Enrollment (EF) survey components within the same data collection year (see letter A in exhibit 3).

Exhibit 3. Alignment of enrollment counts and cohorts across IPEDS survey components

For a full explanation of the alignment of student counts and cohorts across IPEDS survey components (letters A to H in exhibit 3), visit the Student Cohorts and Subgroups in IPEDS resource page.

Be sure to follow NCES on Twitter, Facebook, LinkedIn, and YouTube, follow IPEDS on Twitter, and subscribe to the NCES News Flash to stay up-to-date on IPEDS data releases and resources.

By Katie Hyland and Roman Ruiz, AIR

NCES is pleased to present the 2022 edition of the Condition of Education. The Condition is part of a 150-year tradition at NCES and provides historical and contextual perspectives on key measures of educational progress to Congress and the American public. This report uses data from across NCES and from other sources and is designed to help policymakers and the public monitor the latest developments and trends in U.S. education.

The foundation of the Condition of Education is a series of online indicators. Fifty-two of these indicators include content that has been updated this year. Each indicator provides detailed information on a unique topic, ranging from prekindergarten through postsecondary education, as well as labor force outcomes and international comparisons. In addition to the online indicator system, a synthesized overview of findings across topics is presented in the Report on the Condition of Education.

This year, we are excited to begin the rollout of interactive figures. These new interactive figures will empower users to explore the data in different ways. A selection of these indicators are highlighted here. They show various declines in enrollment that occurred during the coronavirus pandemic, from early childhood through postsecondary education. (Click the links below to explore the new interactive figures!)

• From 2019 to 2020, enrollment rates of young children fell by 6 percentage points for 5-year-olds (from 91 to 84 percent) and by 13 percentage points for 3- to 4-year-olds (from 54 to 40 percent).
• Public school enrollment in prekindergarten through grade 12 dropped from 50.8 million in fall 2019 to 49.4 million students in fall 2020. This 3 percent drop brought total enrollment back to 2009 levels (49.4 million), erasing a decade of steady growth.
• At the postsecondary level, total undergraduate enrollment decreased by 9 percent from fall 2009 to fall 2020 (from 17.5 million to 15.9 million students). For male and female students, enrollment patterns exhibited similar trends between 2009 and 2019 (both decreasing by 5 percent). However, from 2019 to 2020, female enrollment fell 2 percent, while male enrollment fell 7 percent. Additionally, between 2019 and 2020, undergraduate enrollment fell 5 percent at public institutions and 2 percent at private nonprofit institutions. In contrast, undergraduate enrollment at for-profit institutions was 4 percent higher in fall 2020 than in fall 2019, marking the first positive single year change in enrollments at these institutions since 2010. Meanwhile, at the postbaccalaureate level, enrollment increased by 10 percent between fall 2009 and fall 2020 (from 2.8 million to 3.1 million students).
• Educational attainment is associated with economic outcomes, such as employment and earnings, as well as with changes in these outcomes during the pandemic. Compared with 2010, employment rates among 25- to 34-year-olds were higher in 2021 only for those with a bachelor’s or higher degree (84 vs 86 percent). For those who had completed high school and those with some college, employment rates increased from 2010 to 2019, but these gains were reversed to 68 and 75 percent, respectively, during the coronavirus pandemic. For those who had not completed high school, the employment rate was 53 percent in 2021, which was not measurably different from 2019 or 2010.

This year’s Condition also includes two spotlight indicators. These spotlights use data from the Household Pulse Survey (HPS) to examine education during the coronavirus pandemic.

• Homeschooled Children and Reasons for Homeschooling: This spotlight opens with an examination of historical trends in homeschooling, using data from the National Household Education Survey (NHES). Then, using HPS, this spotlight examines the percentage of adults with students under 18 in the home who were homeschooled during the 2020–21 school year. Some 6.8 percent of adults with students in the home reported that at least one child was homeschooled in 2020–21. The percentage was higher for White adults (7.4 percent) than for Black adults (5.1 percent) and for Asian adults (3.6 percent). It was also higher for Hispanic adults (6.5 percent) than for Asian adults.
• Impact of the Coronavirus Pandemic on Fall Plans for Postsecondary Education: This spotlight uses HPS data to examine changes in plans for fall 2021 postsecondary education made in response to the coronavirus pandemic. Among adults 18 years old and over who had household members planning to take classes in fall 2021 from a postsecondary institution, 44 percent reported that there was no change for any household member in their fall plans for postsecondary classes. This is compared with 28 percent who reported no change in plans for at least one household member one year earlier in the pandemic, for fall 2020.

The Condition also includes an At a Glance section, which allows readers to quickly make comparisons within and across indicators, as well as a Reader’s Guide, a Glossary, and a Guide to Sources that provide additional information to help place the indicators in context. In addition, each indicator references the source data tables that were used to produce that indicator. Most of these are in the Digest of Education Statistics.

In addition to publishing the Condition of Education, NCES produces a wide range of other reports and datasets designed to help inform policymakers and the public about significant trends and topics in education. More information about the latest activities and releases at NCES may be found on our website or by following us on Twitter, Facebook, and LinkedIn.

By Peggy G. Carr, NCES Commissioner

The emergence of the coronavirus pandemic 2 years ago shifted not only how students received educational services around the world but also how the National Center for Education Statistics (NCES) carried out its mission, which is to collect, analyze, and report statistics on the condition of education in the United States.

NCES has conducted several surveys to measure educational enrollment, experiences, and outcomes as part of existing data collections and created new, innovative, and timely data initiatives. NCES is currently fielding more than 15 projects with information related to the pandemic. Since early 2020, NCES has collected information about educational experiences of students from elementary through postsecondary institutions. A few of the data collections will extend beyond 2022, providing rich data resources that will document changes in the educational landscape throughout the lifecycle of the pandemic.

NCES Coronavirus Pandemic Data Collection Coverage

In order to respond to the call for information about how students learned during widespread school disruptions, NCES modified existing and created new data collection avenues to receive and report vital information in unprecedented ways. Below are summaries of some of the data products available.

• The NAEP Monthly School Survey provided data during the beginning of 2021 on instructional modes offered from schools that served fourth- and eighth-graders. With participants from schools that were part of the NAEP 2022 assessments, this survey was the program’s first-ever monthly data collection and dissemination activity. It answered questions about what learning opportunities schools offered to students across states and how student enrollment changed each month overall and by race/ethnicity.
   
• NCES created the School Pulse Panel in 2021 to provide reliable data on school reopening efforts in public elementary, middle, and high schools nationally. NCES released 2021 summer and early fall results in December and has provided monthly updates since February 2022. The latest results show that the pandemic increased the teacher and staff vacancies in nearly a quarter of participating public schools.
   
• Through our existing administrative data collections, NCES has released enrollment estimates for fall 2020 at the public elementary and secondary levels as well as at the postsecondary level. These data reveal a drop in enrollment compared with 2019—prior to the pandemic.
   
• In February 2022, NCES released a report titled Impact of the Coronavirus (COVID-19) Pandemic on Public and Private Elementary and Secondary Education in the United States (Preliminary Data): Results from the 2020–21 National Teacher and Principal Survey (NTPS). This report provides data on changes to instruction, support, and resources in public and private elementary and secondary schools during the pandemic.
   
• In June 2021, NCES released a report titled 2019–20 National Postsecondary Student Aid Study (NPSAS:20): First Look at the Impact of the Coronavirus (COVID-19) Pandemic on Undergraduate Student Enrollment, Housing, and Finances (Preliminary Data). This report focuses on how the pandemic affected postsecondary student experiences.
   
• To support parents, educators, and researchers, NCES created a Coronavirus Pandemic Information and Resource page. This page contains common questions related to the pandemic and its impact on education.

Looking ahead, NCES will provide NAEP data on how student performance has changed in various subjects since the coronavirus pandemic began. NCES will also collect and report information about learning contexts, which are critical for understanding educational outcomes. NCES will also develop a new system to share pandemic-related data collected across the center.

All of these resources are currently available or will be available on the NCES website.

By Ebony Walton and Josh DeLaRosa, NCES