NCES Blog

National Center for Education Statistics

Using Federal Education Data to Inform Policymaking: Part 1–Benefits and Advantages

August 30, 2023 NCES Blog Editor FAQs, General Share on TwitterShare on FacebookShare on Google+

While federal, state, and district policymakers have used education data as the backbone of their policy and funding decisions for years, there’s nothing quite like a global pandemic to highlight the criticality of reliable data and illuminate the gaps in our collective knowledge. 

But where can policymakers find education datasets that are large enough for comparative or trend analyses while still specific enough to measure timely issues in local contexts? How can policymakers extract and interpret information from these education datasets? The National Center for Education Statistics (NCES) is a perfect resource for these data and information needs.  

In this two-part blog series, we’ll discuss the role of NCES as the primary federal entity for collecting and analyzing essential education data in the United States and highlight a specific NCES survey—the National Teacher and Principal Survey (NTPS)—which is designed to support state and district policymakers.

Federal, state, and district decisionmakers need reliable, trustworthy data to inform education funding and policy regulations. In order to enact good laws that best serve all of our students and school staff, they need data that are as diverse and representative as our schools. As a federal statistical agency, NCES fulfills a Congressional mandate to collect, analyze, and report statistics on the condition of U.S. education and is the primary source that policymakers and other decisionmakers rely on for education data. These efforts include administrative data collections and cross-sectional, longitudinal, and assessment surveys that gather information to help the education sector better understand early childhood, K–12, and postsecondary education nationally and internationally.

The NTPS exemplifies the utility of NCES data. NTPS data are available both nationally and by state (via the NTPS State Dashboard and DataLab) and are used by policymakers and researchers to make funding and other policy decisions. NCES also helps decisionmakers, researchers, and the public use and make sense of the data by providing access to NTPS datasets and publishing reports, such as numerous NTPS reports, the Condition of Education, and the Digest of Education Statistics.

The NTPS collects data about school conditions and the demographics of public and private K–12 teachers and principals directly from school staff themselves, providing critical data on educators’ perspectives and experiences in schools every day.

The NTPS has been collected in one form or another since 1987–88—when it was known as the Schools and Staffing Survey (SASS)—and was last conducted during the 2020–21 school year amid the coronavirus pandemic. The 2023–24 NTPS is currently being conducted.

Let’s use the NTPS to answer a few common questions about the role of federal education data.

1. Why do federal data matter to district policymakers if states and districts have their own local collections?

In a postpandemic world cleaved into “before” and “after,” policymakers at all levels need information on the condition of education across the country to craft policies that are truly reflective of the needs, challenges, and strengths of students and staff.

Since education in the United States is primarily a state and local responsibility, it can be difficult to make comparisons between states if we don’t have a federal agency collecting the data in a systematic and comparable way across the country. The NTPS, for example, publishes both public school data at the national and state levels and representative public and private school, principal, and teacher data for several characteristics (e.g., type of community in which a school is located; percentage enrollment of students of color; staff characteristics like race/ethnicity and years of experience).  

Figure 1 shows an NTPS-based example of how using common questions across all school systems supports important cross-state comparisons. This is just one of hundreds of similar comparisons that have been made using NTPS data on topics such as teachers’ classroom experiences and principals’ challenges filling needed teacher vacancies. Comparisons can also focus on different school, principal, and teacher characteristics (e.g., type of community in which a school is located; level of training for staff; race/ethnicity of staff).

Figure 1. Percentage of public schools that provide instruction beyond the school day for students who need academic assistance: 2020–21

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Teacher and Principal Survey (NTPS), “Public School Data File,” 2020–21.

The primary responsibility of state or district education decisionmakers is to use trustworthy data to support the needs of their local schools and families Thankfully, state, district, and school leadership don’t need to assume the full financial and logistical responsibility on their own when there are federal data available that can help with state and local data needs. The same federal education data underpinning congressional funding decisions, policy choices, and guidance can be used for numerous state, district, and school policy and practice decisions as well—if education leaders know where to look.

Federal, state, and district education agencies and schools all serve different roles in the education sector but have similar and mutually beneficial responsibilities and goals on behalf of students and school staff (figure 2).

Figure 2. Mutually beneficial relationships

NCES and its predecessors have been congressionally mandated since 1867 to collect, analyze, and report data on the condition and progress of U.S. education for policymakers to use as a tool when making decisions to support our students and our school staff. National and state-level estimates from NCES surveys support state and district data efforts and strategic goals. For example, the California State Senate used state-level NTPS school start time data1 to inform SB:328 (a bill to require California school districts to shift middle and high school start times to no earlier than 8:30 a.m.), which was passed in 2017 and amended in 2021.  

2. How do federal data benefit everyone in the education sector?

NCES produces unique data and information products that rely on statistics produced from data collected through state or district records and a suite of surveys, the majority of which come directly from responses given by educators, students, and families. For example, NCES produces an annual report to Congress called the Condition of Education. The Condition of Education summarizes and makes sense of data from more than 25 data collections administered by NCES and other government agencies. Federal policymakers also rely on other NCES reports, such as the annual Digest of Education Statistics, Projections of Education Statistics, and Report on Indicators of School Crime and Safety. For an example of the indicators available in the Condition of Education, see the figure below, which is from Characteristics of Traditional Public, Public Charter, and Private School Teachers.

Figure 3. Percentage distribution of teachers in traditional public, public charter, and private elementary and secondary schools, by highest degree earned: School year 2020–21

 

1 Education specialist degrees or certificates are generally awarded for 1 year’s work beyond the master’s level. Includes certificate of advanced graduate studies.
NOTE: Excludes teachers who teach only prekindergarten. Data are based on a head count of full-time and part-time teachers rather than on the number of full-time-equivalent teachers. Detail may not sum to totals because of rounding. Although rounded numbers are displayed, the figures are based on unrounded data.
SOURCE: U.S. Department of Education, National Center for Education Statistics, National Teacher and Principal Survey (NTPS), “Public School Teacher Data File” and “Private School Teacher Data File,” 2020–21. See Digest of Education Statistics 2022, tables 209.10 and 209.21.

The Condition of Education and other NCES reports and data products provide information on key topics in education to the U.S. Senate and House of Representatives, the White House Domestic Policy Council, and senior staff within many federal agencies including the Department of Education, Department of Health and Human Services (HHS), National Institutes of Health (NIH), Department of Justice (DOJ), and Department of Agriculture (USDA). Some of the recent policy initiatives and research initiatives supported by NTPS data include the following:

 

In part 2 of this blog series, we will present the challenges and opportunities created by using federal education data to inform policymaking at the federal, state, and district levels. 

NCES would like to thank every district, school, administrator, teacher, parent, and student who has previously approved or participated in an NCES survey. We wouldn’t be able to produce our reports and data products without your participation.

We are currently conducting the 2023–24 NTPS to learn more about school and educator experiences following the pandemic. Find more information about the NTPS, including findings and details from prior collections.

 

By Maura Spiegelman and Julia Merlin, NCES

[1] The California State Senate Bill 328 referenced data from the Schools and Staffing Survey (SASS), which was the direct predecessor to the NTPS.

Releasing CCD Nonfiscal Data

May 31, 2023 NCES Blog Editor FAQs, General Share on TwitterShare on FacebookShare on Google+

The Common Core of Data (CCD) contains basic information on public elementary and secondary schools, local education agencies (LEAs), and state education agencies (SEAs) in the United States. The CCD collects fiscal and nonfiscal data about all public schools, public school districts, and state education agencies in the United States. Both IPEDS and CCD provide a sampling frame to many survey collections, including many conducted by NCES and the Department of Education. This blog post, one in a series of posts about CCD nonfiscal data, focuses on CCD’s two major releases and their corresponding components. For information on how to access and use CCD data, read the blog post Accessing the Common Core of Data (CCD).
 

Data Releases

CCD nonfiscal data are published in two releases every school year—as preliminary files and as provisional data files—within the CCD Data File tool. Understanding the differences between the two releases is important to understand how CCD nonfiscal data are released.

  • The preliminary files contain basic information about schools and districts, such as name, address, phone number, status, and NCES ID number. Many schools and districts utilize information from the directory file, such as the NCES ID, to apply for grants or other opportunities for their schools. Therefore, it is important that these files are released first, even if the data are still preliminary. 
     
  • The provisional data files are the full release of the CCD nonfiscal data. These data files provide school-, district-, and state-level data on topics like enrollment, staffing, and free or reduced-price lunch. These files are much more detailed and include data that are broken down by characteristics such as grade, race/ethnicity, and gender—as well as by combinations of these characteristics. These files are not updated unless there is a significant change to the data.

Each file release includes a version that indicates the type of release. The first preliminary files have “0a” in the file names, and revised preliminary files include “0b,” “0c,” and so on. The first provisional files have “1a,” in the file names, and revised provisional files include “1b,” “1c,” and so on. Note, however, that releasing revised files is rare.
 

Components of a Release

It is important to utilize the various components that accompany each release to find additional information that is specific to the file and can help you better understand the data. In addition, there are other resources available that provide more ways to access and understand the data.
 

Documentation Components

Every data file will have documentation files that provide information about the data. These include the following:

  • release notes—basic information about the data release, including details about any changes to the files, such as a change in a variable’s description or a variable that was added to the file; summary tables that include national totals and tables with selected frequencies are also included.
     
  • state data notes—information on data anomalies that are discovered during NCES’s collaboration with the states; broken down by state and by file type, these notes describe things like changes to how data were collected by the state.
     
  • companion files—included in each data file component, these files include a list of all the variables in the data file—including a brief description—and frequency tables; you should start with the companion files to better understand what variables are in each data file.

Resources and Tools

Along with the release of the CCD nonfiscal data files, additional resources are also updated to improve access to the data.

  • Summary Tables: Released with the provisional data files, Summary Tables provide a national-level look at the data. These tables show the operational status of schools and districts by type as well as the number of schools, students, and teachers by state.
     
  • Locators and ElSi: There are two primary tools that can be used to access CCD data: the Locators (School Locator and District Locator) and the Elementary/Secondary Information System (ElSi). These tools are updated as the data files are released. The Locators are updated with each release, while ElSi is updated with the release of the provisional data files. Learn more about these tools.
     
  • Online Documentation: The online documentation provides some general information about CCD. This information is not year specific, but it provides a detailed explanation about how the data are collected, processed, and reviewed.
  • Reference Library: The reference library includes detailed documentation on various components of the CCD files that applies to multiple years, levels, and components of the data collection. The library includes crosswalks, documentation describing changes to the collection, and guidance for utilizing the data files, such as how to aggregate free or reduced-price lunch data.

Be sure to follow NCES on Twitter, Facebook, LinkedIn, and YouTube and subscribe to the NCES News Flash to stay up-to-date on future CCD releases and resources.

 

By Patrick Keaton, NCES

NCES Releases a New Interactive Data Visualization Tool on Revenues, Expenditures, and Attendance for Public Elementary and Secondary Education

September 29, 2022 NCES Blog Editor Findings, General Share on TwitterShare on FacebookShare on Google+

To accompany the recently released Revenues and Expenditures for Public Elementary and Secondary Education FY 2020, NCES has created an interactive data visualization tool to highlight the per pupil revenues and expenditures (adjusted for inflation) and average daily attendance (ADA) trends from the fiscal year (FY) 2020 National Public Education Financial Survey.

This tool allows users to see national or state-specific per pupil amounts and year-to-year percentage changes for both total revenue and current expenditures by using a slider to toggle between the two variables. Total revenues are shown by source, and total current expenditures are shown by function and subfunction. Clicking on a state in the map will display data for the selected state in the bar charts.

The tool also allows users to see the ADA for each state. It is sortable by state, ADA amount, and percentage change. It may also be filtered to easily compare selected states. Hovering over the ADA of a state will display another bar graph with the last 3 years of ADA data.

Revenues and Expenditures

Between FY 2019 and FY 2020, inflation-adjusted total revenues per pupil increased by 1.8 percent (to $15,711). Of these total revenues for education in FY 2020, the majority were provided by state and local governments ($7,461 and $7,056, respectively).

The percentage change in revenues per pupil from FY 2019 to FY 2020 ranged from +15.4 percent in New Mexico to -2.4 percent in Kentucky. Total revenues per pupil increased in 38 states and the District of Columbia and decreased in 12 states between FY 2019 and FY 2020.

[click to enlarge image]Image of revenues tab of the Finance Visualization Tool showing revenues per pupil for public elementary and secondary education in FY 2019 and FY 2020

In FY 2020, current expenditures per pupil for the United States were $13,489, up 0.5 percent from FY 2019, after adjusting for inflation. Current expenditures per pupil ranged from $8,287 in Utah to $25,273 in New York. After New York, current expenditures per pupil were highest in the District of Columbia ($23,754), Vermont ($22,124), New Jersey ($21,385), and Connecticut ($20,889). After Utah, current expenditures per pupil were lowest in Idaho ($8,337), Arizona ($8,694), Oklahoma ($9,395), and Nevada ($9,548).

The states with the largest increases in current expenditures per pupil from FY 2019 to FY 2020, after adjusting for inflation, were New Mexico (+9.3 percent), Illinois (+5.7 percent), Kansas (+4.0 percent), Texas (+3.7 percent), and Indiana (+3.7 percent). The states with the largest decreases were Delaware1 (-12.8 percent), Connecticut (-2.7 percent), Arizona (-2.4 percent), Alaska (-2.0 percent), and Arkansas (-1.9 percent).

Average Daily Attendance (ADA)

During FY 2020, many school districts across the country closed their school buildings for in-person learning and began providing virtual instruction in an effort to prevent the spread of COVID-19. In order to collect the most consistent and measurable data possible, the U.S. Department of Education provided flexibility for states to report average daily attendance data for the 2019–20 school year.

Between FY 2019 and FY 2020, ADA decreased in 14 states, with the largest decrease at 2.4 percent in New Mexico. ADA increased in the remaining 36 states and the District of Columbia, with the largest increase at 4.1 percent in South Dakota. In 43 states, the ADA in FY 2020 was within 2 percent of the previous year’s ADA.

[click to enlarge image]

Image of Average Daily Attendance tab of the Finance Visualization Tool showing average daily attendance for public elementary and secondary education by state in FY 2020

To explore these and other data on public elementary and secondary revenues, expenditures, and ADA, check out our new data visualization tool.

Be sure to follow NCES on Twitter, Facebook, LinkedIn, and YouTube and subscribe to the NCES News Flash to stay up-to-date on the latest from the National Public Education Financial Survey.

 

By Stephen Q. Cornman, NCES, and Malia Howell and Jeremy Phillips, U.S. Census Bureau

[1] In Delaware, the decline in current expenditures per pupil is due primarily to a decrease in the amount reported for employee benefits paid by the state on behalf of local education agencies (LEAs). The state reviewed this decline and provided corrected data that will be published in the final file.

Timing is Everything: Understanding the IPEDS Data Collection and Release Cycle

August 10, 2022 NCES Blog Editor FAQs, General Share on TwitterShare on FacebookShare on Google+

For more than 3 decades, the Integrated Postsecondary Education Data System (IPEDS) has collected data from all postsecondary institutions participating in Title IV federal student aid programs, including universities, community colleges, and vocational and technical schools.

Since 2000, the 12 IPEDS survey components occurring in a given collection year have been organized into three seasonal collection periods: Fall, Winter, and Spring.

The timing of when data are collected (the “collection year”) is most important for the professionals who report their data to the National Center for Education Statistics (NCES). However, IPEDS data users are generally more interested in the year that is actually reflected in the data (the “data year”). As an example, a data user may ask, “What was happening with students, staff, and institutions in 2018–19?"

Text box that says: The collection year refers to the time period the IPEDS survey data are collected. The data year refers to the time period reflected in the IPEDS survey data.

For data users, knowing the difference between the collection year and the data year is important for working with and understanding IPEDS data. Often, the collection year comes after the data year, as institutions need time to collect the required data and check to make sure they are reporting the data accurately. This lag between the time period reflected by the data and when the data are reported is typically one academic term or year, depending on the survey component. For example, fall 2021 enrollment data are not reported to NCES until spring 2022, and the data would not be publicly released until fall 2022.

After the data are collected by NCES, there is an additional time period before they are released publicly in which the data undergo various quality and validity checks. About 9 months after each seasonal collection period ends (i.e., Fall, Winter, Spring), there is a Provisional Data Release and IPEDS data products (e.g., web tools, data files) are updated with the newly released seasonal data. During this provisional release, institutions may revise their data if they believe it was inaccurately reported. A Revised/Final Data Release then happens the following year and includes any revisions that were made to the provisional data.

Sound confusing? The data collection and release cycle can be a technical and complex process, and it varies slightly for each of the 12 IPEDS survey components. Luckily, NCES has created a comprehensive resource page that provides information about the IPEDS data collection and release cycles for each survey component as well as key details for data users and data reporters, such as how to account for summer enrollment in the different IPEDS survey components.

Table 1 provides a summary of the IPEDS 2021–22 data collection and release schedule information that can be found on the resource page. Information on the data year and other details about each survey component can also be found on the resource page.

Table 1. IPEDS 2021–22 Data Collection and Release Schedule

Table showing the IPEDS 2021–22 data collection and release schedule

Here are a few examples of how to distinguish the data year from the collection year in different IPEDS data products.

Example 1: IPEDS Trend Generator

Suppose that a data user is interested in how national graduation rates have changed over time. One tool they might use is the IPEDS Trend Generator. The Trend Generator is a ready-made web tool that allows users to view trends over time on the most frequently asked subject areas in postsecondary education. The Graduation Rate chart below displays data year (shown in green) in the headline and on the x-axis. The “Modify Years” option also allows users to filter by data year. Information about the collection year (shown in gold) can be found in the source notes below the chart.

Image of IPEDS Trend Generator webpage

Example 2: IPEDS Complete Data Files

Imagine that a data user was interested enough in 6-year Graduation Rates that they wanted to run more complex analyses in a statistical program. IPEDS Complete Data Files include all variables for all reporting institutions by survey component and can be downloaded by these users to create their own analytic datasets.

Data users should keep in mind that IPEDS Complete Data Files are organized and released by collection year (shown in gold) rather than data year. Because of this, even though files might share the same collection year, the data years reflected within the files will vary across survey components.

Image of IPEDS Complete Data Files webpage

The examples listed above are just a few of many scenarios in which this distinction between collection year and data year is important for analysis and understanding. Knowing about the IPEDS reporting cycle can be extremely useful when it comes to figuring out how to work with IPEDS data. For more examples and additional details on the IPEDS data collection and release cycles for each survey component, please visit the Timing of IPEDS Data Collection, Coverage, and Release Cycle resource page.

Be sure to follow NCES on Twitter, Facebook, LinkedIn, and YouTube, follow IPEDS on Twitter, and subscribe to the NCES News Flash to stay up-to-date on all IPEDS data releases.

 

By Katie Hyland and Roman Ruiz, American Institutes for Research

Accessing the Common Core of Data (CCD)

January 4, 2021 NCES Blog Editor FAQs, General Share on TwitterShare on FacebookShare on Google+

Every year, NCES releases nonfiscal data files from the Common Core of Data (CCD), the Department of Education’s (ED’s) primary longitudinal database on public elementary and secondary education in the United States. CCD data releases include directory data (location, status, and grades offered), student membership data (by grade, gender, and race/ethnicity), data on full-time equivalent staff and teachers, and data on the number of students eligible for the National School Lunch Program (NSLP). 

This blog post, one in a series of posts about CCD data, focuses on how to access and use the data. For information on using NSLP data, read the blog post Understanding School Lunch Eligibility in the Common Core of Data. 

CCD Data Use

CCD data are used both internally by ED and externally by the public. For example, within ED, CCD data serve as the sample frame for the National Assessment of Educational Progress (NAEP) and are the mainstay of many tables in the Digest of Education Statistics and The Condition of Education. Outside of ED, CCD data are used by researchers, the general public (e.g., realtor sites, The Common Application, Great Schools), and teachers who need their school’s NCES school ID to apply for grants.

Data Structure and Availability

CCD data are available at the state, district, and school levels, using a nested structure: all schools are within a parent district and all districts are within a state. CCD does not include any student- or staff-level data.

Most CCD data elements are available for school year (SY) 1986‒87 to the present.    

Unique Identifiers Within CCD

NCES uses a three-part ID system for public schools and districts: state-based Federal Information Processing Standards (FIPS) codes, district codes, and school codes. Using these three parts, several IDs can be generated:

  • District IDs: 7-digit (FIPS + 5-digit District)
  • School IDs:
    • 12-digit (FIPS + District + School)
    • 7-digit (FIPS + School) (unique from SY 2016‒17 on)

NCES IDs are assigned to districts and schools indefinitely, making them useful for analyzing data over time. For example, for a longitudinal school-level analysis, a school’s 7-digit ID should be used, as it remains the same even if the school changes districts. These IDs can also be used to link CCD district and school data to other ED databases.

Accessing CCD Data

There are three ways to access CCD data: the CCD District and School Locators, the Elementary/Secondary Information System (ElSi), and the raw data files. Each approach has different benefits and limitations.

  • CCD District and School locators
    • Quick and easy to use
    • Many ways to search for districts and schools (e.g., district/school name, street address, county, state)
    • Provides the latest year of CCD data available for the selected district(s) or school(s)
    • Tips for optimal use:
      • If you are having difficulty finding a district or school, only enter a key word for the name (e.g., for PS 100 Glen Morris in New York City, only enter “Glen Morris” or “PS 100”)
      • Export search results to Excel (including all CCD locator fields)

  • Elementary/Secondary Information System (ElSi)
    • quickFacts and expressTables: view most-requested CCD data elements at multiple levels
    • tableGenerator: combine data across topic areas and years to create a single file
    • Create “tables” that act like databases and include all of the roughly 100,000 public schools or 20,000 districts
    • Export data to Excel or CSV
    • Tips for optimal use:
      • Save and edit queries using the navigation buttons at the top of the screen
      • popularTables provide links to frequently requested data

 

Interested in learning more about CCD or accessing CCD data at the state, district, or school level? Check out the CCD website and use the District and School locators, ElSi, or the raw data files to find the data you are looking for.

 

By Patrick Keaton, NCES