International and U.S. Response Rates

Return to Methodology and Technical Notes

This section describes the success of participating education systems in meeting the international technical standards on data collection. Information is provided for all participating education systems on their coverage of the target population, exclusion rates, and response rates.

Table A-2 provides information on weighted school participation rates before and after school replacement and the number of participating schools after replacement for each participating education system. Table A-3 provides information on coverage of the target population, overall exclusion rates, weighted student response rates after school replacement, and the number of participating students after replacement for each participating education system.

One hundred forty two participating original schools and 35 replacement schools participated in the U.S. administration of PISA. This resulted in 177 participating schools and an overall weighted school response rate of 83 percent. The overall weighted student response rate was 90 percent and the U.S. overall student exclusion rate was 3 percent.

In Massachusetts, there were 48 participating schools (out of 53 eligible schools), resulting in an overall weighted school response rate of 92 percent. The overall weighted student response rate was 90 percent and the overall student exclusion rate was 4 percent. All eligible schools (54) participated in North Carolina, yielding an overall weighted school response rate of 100 percent with an overall weighted student response rate of 90 percent and an exclusion rate of 5 percent. All of Puerto Rico's, 47 eligible schools participated. The weighted student response rate and exclusion rate were 93 percent and 3 percent, respectively.

See http://nces.ed.gov/surveys/pisa/pisa2015highlights_8i.asp for PISA international sampling guidelines and requirements regarding accommodations, exclusions, and response rate requirements, as well as response rates of all participating education systems.

Table A-2. Number of schools and weighted participation rates, by education system: 2015

Education system	Percent
	Weighted school participation before replacement	Weighted school participation after replacement	Number of participating schools after replacement
Albania	99.8	99.8	229
Algeria	96.1	96.1	159
Australia	94.4	94.9	723
Austria	100.0	100.0	269
B-S-J-G (China)	87.7	100.0	268
Belgium	83.1	95.4	286
Brazil	93.2	94.1	815
Bulgaria	99.6	100.0	180
Canada	74.5	78.6	726
Chile	92.4	99.1	226
Chinese Taipei	100.0	100.0	214
Colombia	98.6	99.8	371
Costa Rica	99.1	99.1	204
Croatia	99.8	99.8	160
Cyprus	96.8	96.8	122
Czech Republic	98.1	98.1	339
Denmark	90.5	92.0	331
Dominican Republic	98.9	98.9	193
Estonia	99.9	99.9	206
Finland	99.8	100.0	168
France	90.8	94.3	241
Georgia	97.5	98.8	262
Germany	96.2	98.9	253
Greece	92.2	98.5	209
Hong Kong (China)	75.1	90.2	138
Hungary	93.4	98.8	244
Iceland	98.8	98.8	122
Indonesia	98.4	100.0	236
Ireland	99.3	99.3	167
Israel	90.9	93.0	173
Italy	74.4	87.5	464
Japan	94.5	99.0	198
Jordan	100.0	100.0	250
Korea, Republic of	99.6	99.6	168
Kosovo	100.0	100.0	224
Latvia	86.5	92.5	248
Lebanon	66.6	87.3	270
Lithuania	99.4	99.9	310
Luxembourg	100.0	100.0	44
Macau (China)	100.0	100.0	45
Macedonia, Republic of	99.7	99.7	106
Malta	100.0	100.0	59
Mexico	95.5	97.5	275
Moldova, Republic of	100.0	100.0	229
Montenegro, Republic of	99.8	99.8	64
Netherlands	63.3	93.2	184
New Zealand	71.4	84.5	176
Norway	95.2	95.2	229
Peru	99.5	99.8	281
Poland	88.5	99.3	168
Portugal	85.9	95.1	238
Qatar	99.0	99.0	166
Romania	99.4	100.0	182
Russian Federation	99.4	99.4	209
Singapore	97.2	97.7	176
Slovak Republic	92.7	98.8	288
Slovenia	97.7	97.7	333
Spain	98.9	100.0	201
Sweden	99.7	99.7	202
Switzerland	93.2	97.7	225
Thailand	98.5	100.0	273
Trinidad and Tobago	91.6	91.6	141
Tunisia	99.2	99.2	163
Turkey	96.9	99.1	187
United Arab Emirates	98.5	98.5	473
United Kingdom	83.7	92.6	547
United States	66.7	83.3	177
Uruguay	98.3	99.3	219
Vietnam	100.0	100.0	188
U.S. states and territories
Massachusetts	78.4	91.9	48
North Carolina	100.0	100.0	54
Puerto Rico	100.0	100.0	47

NOTE: In calculating school participation rates, each school received a weight equal to the product of its base weight (the reciprocal of its probability of selection) and the number of age-eligible students enrolled in the school, as indicated on the sampling frame. Weighted school participation before replacement refers to the sum of weights of the original sample schools with PISA-assessed students and a student response rate of at least 50 percent over the sum of weights of all original sample schools. Weighted school participation after replacement refers to the sum of weights of the original and replacement schools with PISA-assessed students and a student response rate of at least 50 percent over the sum of weights of responding original sample schools, responding replacement schools, and eligible refusing original sample schools. Italics indicate non-OECD countries and education systems. B-S-J-G (China) refers to the four PISA participating China provinces: Beijing, Shanghai, Jiangsu, and Guangdong. Results for Massachusetts and North Carolina are for public schools only.

SOURCE: Organization for Economic Cooperation and Development (OECD), Program for International Student Assessment (PISA), 2015.

Table A-3. Coverage of target population, student exclusion and weighted participation rates, and number of students, by education system: 2015

Education system	Total population of 15-year-olds (number)	Percent				Number of participating students
		Coverage of 15-year-old population	Coverage of national desired population	Overall student exclusion rate	Weighted student participation after replacement
Albania	48,610	84.1	100.0	0.0	94.0	5,215
Algeria	389,315	78.8	100.0	0.0	92.0	5,519
Australia	282,888	90.6	94.7	5.3	84.0	14,530
Austria	88,013	83.4	97.9	2.1	87.0	7,007
B-S-J-G (China)	2,084,958	63.9	95.9	4.1	97.0	9,841
Belgium	123,630	92.9	98.3	1.7	91.0	9,651
Brazil	3,803,681	63.8	97.2	2.8	87.0	23,141
Bulgaria	66,601	80.6	97.3	2.7	95.0	5,928
Canada	396,966	83.5	92.5	7.5	81.0	20,058
Chile	255,440	79.8	98.3	1.7	93.0	7,053
Chinese Taipei	295,056	85.2	99.3	0.7	98.0	7,708
Colombia	760,919	74.6	99.9	0.1	95.0	11,795
Costa Rica	81,773	63.5	99.8	0.2	92.0	6,866
Croatia	45,031	90.8	96.4	3.6	91.0	5,809
Cyprus	9,255	94.9	95.6	4.4	94.0	5,571
Czech Republic	90,391	93.5	97.6	2.4	89.0	6,894
Denmark	68,174	89.0	95.0	5.0	89.0	7,161
Dominican Republic	193,153	68.5	98.2	1.8	94.0	4,740
Estonia	11,676	92.8	94.5	5.5	93.0	5,587
Finland	58,526	97.3	97.2	2.8	93.0	5,882
France	807,867	91.0	95.8	4.2	88.0	6,108
Georgia	48,695	78.7	95.5	4.5	94.0	5,316
Germany	774,149	96.1	97.9	2.1	93.0	6,522
Greece	105,530	91.1	98.1	1.9	94.0	5,532
Hong Kong (China)	65,100	88.6	98.2	1.8	93.0	5,359
Hungary	94,515	89.6	96.7	3.3	92.0	5,658
Iceland	4,250	93.3	96.4	3.6	86.0	3,374
Indonesia	4,534,216	68.2	99.9	0.1	98.0	6,513
Ireland	61,234	96.5	96.9	3.1	89.0	5,741
Israel	124,852	93.7	96.6	3.4	90.0	6,598
Italy	616,761	80.3	96.2	3.8	88.0	11,583
Japan	1,201,615	94.7	97.6	2.4	97.0	6,647
Jordan	126,399	86.0	99.0	1.0	97.0	7,267
Korea, Republic of	620,687	91.7	99.1	0.9	99.0	5,581
Kosovo	31,546	70.8	95.2	4.8	99.0	4,826
Latvia	17,255	88.8	94.9	5.1	90.0	4,869
Lebanon	64,044	66.1	97.9	2.1	95.0	4,546
Lithuania	33,163	90.2	94.9	5.1	91.0	6,525
Luxembourg	6,327	87.6	91.8	8.2	96.0	5,299
Macau (China)	5,100	88.4	99.9	0.1	99.0	4,476
Macedonia, Republic of	16,719	94.8	98.3	1.7	95.0	5,324
Malta	4,397	97.7	97.6	2.4	85.0	3,634
Mexico	2,257,399	61.7	99.1	0.9	95.0	7,568
Moldova, Republic of	31,576	92.9	99.0	1.0	98.0	5,325
Montenegro, Republic of	7,524	90.1	94.8	5.2	94.0	5,665
Netherlands	201,670	95.1	96.3	3.7	85.0	5,385
New Zealand	60,162	90.2	93.5	6.5	80.0	4,520
Norway	63,642	91.3	93.3	6.7	91.0	5,456
Peru	580,371	74.4	98.5	1.5	99.0	6,971
Poland	380,366	90.9	97.6	2.4	88.0	4,478
Portugal	110,939	87.6	98.7	1.3	82.0	7,325
Qatar	13,871	93.4	95.8	4.2	94.0	12,083
Romania	176,334	93.1	98.9	1.1	99.0	4,876
Russian Federation	1,176,473	95.3	97.7	2.3	97.0	6,036
Singapore	48,218	95.9	98.7	1.3	93.0	6,115
Slovak Republic	55,674	89.2	95.7	4.3	92.0	6,350
Slovenia	18,078	92.8	96.9	3.1	92.0	6,406
Spain	440,084	90.9	96.8	3.2	89.0	6,736
Sweden	97,749	93.6	94.3	5.7	91.0	5,458
Switzerland	85,495	96.2	95.6	4.4	92.0	5,860
Thailand	895,513	70.9	98.4	1.6	97.0	8,249
Trinidad and Tobago	17,371	76.0	100.0	0.0	79.0	4,692
Tunisia	122,186	93.0	99.4	0.6	86.0	5,375
Turkey	1,324,089	69.9	98.9	1.1	95.0	5,895
United Arab Emirates	51,687	90.8	97.8	2.2	95.0	14,167
United Kingdom	747,593	84.0	91.8	8.2	89.0	14,157
United States	4,220,325	83.5	96.7	3.3	90.0	5,712
Uruguay	53,533	71.5	99.9	0.1	86.0	6,062
Vietnam	1,803,552	48.5	99.4	0.6	100.0	5,826
U.S. states and territories
Massachusetts	80,631	75.6	95.6	4.4	90.0	1,391
North Carolina	130,833	79.6	95.4	4.6	92.0	1,887
Puerto Rico	50,321	60.1	96.9	3.1	93.0	1,398

NOTE: In calculating student participation rates, each student received a weight (student base weight) equal to the product of the school base weight—for the school in which the student was enrolled—and the reciprocal of the student selection probability within the school. Coverage of 15-year-old population refers to the extent to which the weighted participants covered the target population of all enrolled students in grades 7 and above. Coverage of national desired population refers to the extent to which the weighted participants covered the national population of 15-year-olds under the non-excluded portion of the student sample. Overall student exclusion rate is the percentage of students excluded for intellectual or functional disabilities, or insufficient assessment language experience at either the school level or within schools. Weighted student participation after replacement refers to the sum of weights of students in original and replacement schools with PISA-assessed students and a student response rate of at least 50 percent over the sum of weights of students in responding original sample schools, responding replacement schools, and eligible refusing original sample schools. Italics indicate non-OECD countries and education systems. B-S-J-G (China) refers to the four PISA participating China provinces: Beijing, Shanghai, Jiangsu, and Guangdong. Results for Massachusetts and North Carolina are for public school students only.

SOURCE: Organization for Economic Cooperation and Development (OECD), Program for International Student Assessment (PISA), 2015.