Table of Contents | Search Technical Documentation | References

NAEP Instruments → Contextual Items (Survey Questionnaires) → Indices Based on Questionnaire Data → Development of the 2018 Grade 8 Civics Indices

NAEP Technical DocumentationDevelopment of the 2018 Grade 8 Civics Indices

For the 2018 grade 8 civics assessment, several indices of policy interest were developed that satisfied both theoretical criteria based on content analysis, and empirical criteria based on multivariate statistical techniques. This resulted in the creation of several new reporting elements. The development of the 2018 grade 8 civics indices can be summarized in three main steps:

1. Question development. New sets of contextual items, such as those exploring students’ persistence in learning and their enjoyment of complex problems, were developed and included in the civics student questionnaire. Through content analysis as part of the item development process, only sets of items that were theoretically interpretable and meaningful as a conceptual unit were included as potential indices to measure specific constructs of interest.

2. Examination of empirical relationships. Factor analysis was used to explore and verify the empirical properties of the data. Construct validity of the potential indices was evaluated through factorial validity with respect to the survey question responses, and the convergent and discriminant validity of the factor with respect to other factors. If the factor had the expected pattern of relationships and non-relationships, the construct validity of the factor as representing the intended index was supported.

3. Index scoring. The partial credit item response theory (IRT) model was used to scale the indices. Scaling of the index items was first conducted to get the item parameters and was based on marginal maximum likelihood methodologies. After the parameters were estimated, expected a posteriori (EAP) scores were calculated as the estimate of the index score. Then, the EAP scores were transformed to have a mean of 10 and a standard deviation of 2 on a scale from 0–20.

Index of Students' Persistence in Learning

The table below presents the items forming the index of students' persistence in learning. This index was designed to measure students' tendency to persevere and work hard in the face of challenges. Grade 8 students were asked to indicate how much each of the four statement items described a person like them (not at all like me, a little bit like me, somewhat like me, quite a bit like me, or very much like me).

Items in the index of eighth-grade students' persistence in learning, grade 8 civics national assessment: 2018
How much does each of the following statements describe a person like you? Select one answer choice on each row.
Response categories
Item			Not at all like me	A little bit like me	Somewhat like me	Quite a bit like me	Very much like me
B034901	a.	I finish whatever I begin.	A	B	C	D	E
B034902	b.	I try very hard even after making mistakes.	A	B	C	D	E
B034903	c.	I keep working hard even when I feel like quitting.	A	B	C	D	E
B034904	d.	I keep trying to improve myself, even when it takes a long time to get there.	A	B	C	D	E
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Index of Students' Academic Self-Discipline

The table below presents the items forming the index of students' academic self-discipline. This index was designed to measure students' tendency to pay attention and stay on task when learning. Grade 8 students were asked to indicate how often they have done each of the four statement items (never or hardly ever, less than half of the time, about half of the time, more than half of the time, or all or almost all of the time).

Items in the index of eighth-grade students' academic self-discipline, grade 8 civics national assessment: 2018
In this school year, how often have you done each of the following? Select one answer choice on each row.
Response categories
Item			Never or hardly ever	Less than half of the time	About half of the time	More than half of the time	All or almost all of the time
B035001	a.	I started working on assignments right away rather than waiting until the last minute.	A	B	C	D	E
B035002	b.	I paid attention and resisted distractions.	A	B	C	D	E
B035003	c.	I stayed on task without reminders from my teacher.	A	B	C	D	E
B035004	d.	I paid attention in class even when I was not interested.	A	B	C	D	E
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Index of Students' Enjoyment of Complex Problems

The table below presents the items forming the index of students' enjoyment of complex problems. This index was designed to measure students' enjoyment of problems and activities that challenge them to think. Grade 8 students were asked to indicate how much each of the four statement items described a person like them (not at all like me, a little bit like me, somewhat like me, quite a bit like me, or very much like me).

Items in the index of eighth-grade students' enjoyment of complex problems, grade 8 civics national assessment: 2018
How much does each of the following statements describe a person like you? Select one answer choice on each row.
Response categories
Item			Not at all like me	A little bit like me	Somewhat like me	Quite a bit like me	Very much like me
B035101	a.	I like complex problems more than easy problems.	A	B	C	D	E
B035102	b.	I like activities that challenge my thinking abilities.	A	B	C	D	E
B035103	c.	I enjoy situations where I will have to think about something.	A	B	C	D	E
B035104	d.	I enjoy thinking about new solutions to problems.	A	B	C	D	E
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Index of Students’ Interest/Enjoyment in Civics

The table below presents the items forming the index of students' interest/enjoyment in civics. This index was designed to measure students' interest in and enjoyment of civics and/or United States government topics, and their views of the importance of learning about civics and/or United States government. Grade 8 students were asked to indicate how much each of the five statement items described them (not at all like me, a little bit like me, somewhat like me, quite a bit like me, or exactly like me).

Items in the index of eighth-grade students' interest/enjoyment in civics, grade 8 civics national assessment: 2018
How much does each of the following statements describe you? Select one answer choice on each row.
Response categories
Item			Not at all like me	A little bit like me	Somewhat like me	Quite a bit like me	Exactly like me
P814101	a.	Civics and/or United States government are my favorite topics to study.	A	B	C	D	E
P814102	b.	I enjoy doing schoolwork about civics and/or United States government.	A	B	C	D	E
P814103	c.	I enjoy discussing civics and/or United States government topics with others.	A	B	C	D	E
P814104	d.	I think that civics and/or United States government schoolwork helps me understand what is happening in the world around me.	A	B	C	D	E
P814105	e.	I think that learning about civics and/or United States government topics will be important for my future.	A	B	C	D	E
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Index of Students’ Confidence in Civics Knowledge and Skills

The table below presents the items forming the index of students' confidence in their civics knowledge and skills. This index was designed to measure students' belief in their abilities to do various civics-related tasks. Grade 8 students were asked to indicate their confidence in doing the task described in each of six items (I definitely can’t, I probably can’t, maybe, I probably can, or I definitely can).

Items in the index of eighth-grade students' confidence in civics knowledge and skills, grade 8 civics national assessment: 2018
Do you think that you would be able to do each of the following? Select one answer choice on each row.
Response categories
Item			I definitely can't	I probably can't	Maybe	I probably can	I definitely can
P813801	a.	Explain the roles and functions of the three branches of the United States government	A	B	C	D	E
P813802	b.	Explain the rights and responsibilities of United States citizens	A	B	C	D	E
P813803	c.	Explain how the United States influences and is influenced by events in other countries	A	B	C	D	E
P813804	d.	Compare the roles and responsibilities of local, state, and national governments in the United States	A	B	C	D	E
P813805	e.	Explain why it is important to pay attention to the political process and government	A	B	C	D	E
P813806	f.	Explain why it is important for individuals to participate in the political process and government	A	B	C	D	E
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Index of Students’ Performance Goals in Civics

The table below presents the items forming the index of students' performance goals in civics. This index was designed to measure students' motivation to show that they are a good student and get better civics and/or United States government grades than others in their class. Grade 8 students were asked to indicate how much each of the four statement items described them (not at all like me, a little bit like me, somewhat like me, quite a bit like me, or exactly like me).

Items in the index of eighth-grade students' performance goals in civics, grade 8 civics national assessment: 2018
How much does each of the following statements describe you? Select one answer choice on each row.
Response categories
Item			Not at all like me	A little bit like me	Somewhat like me	Quite a bit like me	Exactly like me
P813901	a.	I want other students to think I am a good civics and/or United States government student.	A	B	C	D	E
P813902	b.	I want to show others that my civics and/or United States government schoolwork is easy for me.	A	B	C	D	E
P813903	c.	I want to look smart in comparison to the other students in my social studies, civics, and/or United States government class.	A	B	C	D	E
P813904	d.	I want to get better civics and/or United States government grades than most other students in my class.	A	B	C	D	E
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Index of Students’ Mastery Goals in Civics

The table below presents the items forming the index of students' mastery goals in civics. This index was designed to measure students' motivation to learn as much as they can about civics and/or United States government and master new skills in their class. Grade 8 students were asked to indicate how much each of the four statement items described them (not at all like me, a little bit like me, somewhat like me, quite a bit like me, or exactly like me).

Items in the index of eighth-grade students' mastery goals in civics, grade 8 civics national assessment: 2018
How much does each of the following statements describe you? Select one answer choice on each row.
Response categories
Item			Not at all like me	A little bit like me	Somewhat like me	Quite a bit like me	Exactly like me
P814001	a.	I want to learn as much as possible about civics and/or United States government in my class.	A	B	C	D	E
P814002	b.	I want to master a lot of new civics and/or United States government skills in my class.	A	B	C	D	E
P814003	c.	I want to become a better civics and/or United States government student this year.	A	B	C	D	E
P814004	d.	I want to understand as much as I can about civics and/or United States government in my class.	A	B	C	D	E
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Index of Students’ Views on Community Engagement

The table below presents the items forming the index of students' views on community engagement. This index was designed to measure students' views of improving their communities and the importance of being involved in community issues. Grade 8 students were asked to indicate how much each of the five statement items described them (not at all like me, a little bit like me, somewhat like me, quite a bit like me, or exactly like me).

Items in the index of eighth-grade students' views on community engagement, grade 8 civics national assessment: 2018
How much does each of the following statements describe you? Select one answer choice on each row.
Response categories
Item			Not at all like me	A little bit like me	Somewhat like me	Quite a bit like me	Exactly like me
P813701	a.	I think I can make a difference in my community.	A	B	C	D	E
P813702	b.	I think being actively involved in community issues is my responsibility.	A	B	C	D	E
P813703	c.	I think being concerned about state and local issues is an important responsibility for everybody.	A	B	C	D	E
P813704	d.	I have good ideas for programs and projects that would help solve problems in my community.	A	B	C	D	E
P813705	e.	I expect to be involved in improving my community three years from now.	A	B	C	D	E
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Index Item Scoring

Analyses were conducted separately for the paper-based assessment (PBA) and digitally based assessment (DBA) samples. While most 2018 grade 8 civics indices are reported based on DBA data, two indices (students' persistence in learning and students' views on community engagement) are reported based on the combined PBA and DBA data because the missing rates for the items within those indices were ≤15% in the PBA and DBA modes. PBA and DBA tables are provided for those indices in the sections that follow.

For each index item, the response categories were scored as numerical values (e.g., for an item with five response categories, category A was scored as 1, B was scored as 2, C was scored as 3, D was scored as 4, and E was scored as 5). For one of the 2018 grade 8 civics PBA indices and three of the 2018 grade 8 civics DBA indices, item response categories were collapsed; scores for a five-category item thus became 1, 2, 3, and 4 after collapsing. The tables below describe the treatment of the index items.

Recoding of polytomous items for scaling, grade 8 civics PBA national assessment, by index: 2018
Item	Index	Reason for decision	Disposition
B034901	Persistence in learning	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B034902	Persistence in learning	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B034903	Persistence in learning	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B034904	Persistence in learning	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
NOTE: Only indices with missing rates less than or equal to 15 percent are reported. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Recoding of polytomous items for scaling, grade 8 civics DBA national assessment, by index: 2018
Item	Index	Reason for decision	Disposition
B034901	Persistence in learning	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B034902	Persistence in learning	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B034903	Persistence in learning	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B034904	Persistence in learning	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B035001	Academic self-discipline	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B035002	Academic self-discipline	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B035003	Academic self-discipline	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B035004	Academic self-discipline	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B035101	Enjoyment of complex problems	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B035102	Enjoyment of complex problems	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B035103	Enjoyment of complex problems	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
B035104	Enjoyment of complex problems	To improve model-data fit	Collapse categories: 1,2,3,4,5 becomes 1,1,2,3,4
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT Parameters

The partial credit IRT model was used to scale the indices. Scaling of the index items was first conducted to get the item parameters and was based on marginal maximum likelihood methodologies. The following tables show the IRT parameters for the 2018 grade 8 civics indices.

IRT parameters for items in the index of eighth-grade students' persistence in learning, grade 8 civics PBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
B034901	-0.29	0.94	0.13	-1.07	†	†
B034902	-0.57	0.71	0.10	-0.80	†	†
B034903	-0.39	0.69	0.04	-0.73	†	†
B034904	-0.80	0.54	0.09	-0.64	†	†
† Not applicable. NOTE: PBA = Paper-based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT parameters for items in the index of eighth-grade students' persistence in learning, grade 8 civics DBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
B034901	-0.31	1.02	0.04	-1.05	†	†
B034902	-0.56	0.79	0.02	-0.82	†	†
B034903	-0.37	0.75	0.00	-0.75	†	†
B034904	-0.81	0.61	-0.02	-0.59	†	†
† Not applicable. NOTE: DBA = Digitally based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT parameters for items in the index of eighth-grade students' academic self-discipline, grade 8 civics DBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
B035001	0.09	0.82	-0.11	-0.71	†	†
B035002	-0.11	0.92	0.08	-1.00	†	†
B035003	-0.37	0.74	-0.01	-0.72	†	†
B035004	-0.21	0.70	0.03	-0.73	†	†
† Not applicable. NOTE: DBA = Digitally based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT parameters for items in the index of eighth-grade students' enjoyment of complex problems, grade 8 civics DBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
B035101	0.52	0.77	-0.01	-0.76	†	†
B035102	-0.05	0.79	-0.05	-0.74	†	†
B035103	0.00	0.76	0.00	-0.76	†	†
B035104	-0.07	0.67	-0.02	-0.66	†	†
† Not applicable. NOTE: DBA = Digitally based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT parameters for items in the index of eighth-grade students' interest/enjoyment in civics, grade 8 civics DBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
P814101	0.59	0.76	0.49	-0.44	-0.82	†
P814102	0.54	1.00	0.49	-0.42	-1.08	†
P814103	0.31	0.97	0.41	-0.41	-0.98	†
P814104	0.01	1.04	0.55	-0.42	-1.16	†
P814105	-0.05	0.86	0.44	-0.41	-0.89	†
† Not applicable. NOTE: DBA = Digitally based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT parameters for items in the index of eighth-grade students' confidence in civics knowledge and skills, grade 8 civics DBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
P813801	-0.35	1.03	0.64	-0.48	-1.19	†
P813802	-0.39	1.30	0.71	-0.48	-1.52	†
P813803	-0.08	1.45	0.67	-0.58	-1.54	†
P813804	-0.08	1.35	0.66	-0.53	-1.48	†
P813805	-0.28	1.19	0.66	-0.53	-1.32	†
P813806	-0.24	1.08	0.65	-0.48	-1.25	†
† Not applicable. NOTE: DBA = Digitally based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT parameters for items in the index of eighth-grade students' performance goals in civics, grade 8 civics DBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
P813901	0.06	0.88	0.60	-0.43	-1.05	†
P813902	0.20	0.95	0.56	-0.45	-1.05	†
P813903	-0.01	0.76	0.53	-0.40	-0.89	†
P813904	-0.31	0.85	0.45	-0.39	-0.90	†
† Not applicable. NOTE: DBA = Digitally based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT parameters for items in the index of eighth-grade students' mastery goals in civics, grade 8 civics DBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
P814001	-0.04	1.25	0.53	-0.53	-1.25	†
P814002	0.02	1.22	0.52	-0.52	-1.22	†
P814003	-0.13	1.19	0.54	-0.44	-1.29	†
P814004	-0.26	1.17	0.48	-0.50	-1.16	†
† Not applicable. NOTE: DBA = Digitally based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT parameters for items in the index of eighth-grade students' views on community engagement, grade 8 civics PBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
P813701	-0.01	1.19	0.46	-0.36	-1.30	†
P813702	0.33	1.08	0.38	-0.35	-1.11	†
P813703	0.17	1.06	0.32	-0.34	-1.04	†
P813704	0.31	0.92	0.27	-0.27	-0.92	†
P813705	0.39	0.87	0.26	-0.26	-0.88	†
† Not applicable. NOTE: PBA = Paper-based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

IRT parameters for items in the index of eighth-grade students' views on community engagement, grade 8 civics DBA national assessment: 2018
Item	b_j	d_j1	d_j2	d_j3	d_j4	d_j5
P813701	-0.14	1.10	0.57	-0.47	-1.20	†
P813702	0.13	1.11	0.50	-0.46	-1.15	†
P813703	-0.01	1.07	0.54	-0.47	-1.14	†
P813704	0.16	0.95	0.42	-0.44	-0.94	†
P813705	0.20	0.84	0.44	-0.43	-0.85	†
† Not applicable. NOTE: DBA = Digitally based assessment. The number of dji parameters is one less than the number of categories for the item. For items scaled with the partial credit model, parameters a and c are not estimated. The a parameter value is exactly one and the c parameter is exactly zero. For item j, bj represents a location parameter related to item difficulty, and dji represents the category threshold parameter for category i of item j; dji may not sum to zero because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response Averages and Transformed Scores

After the parameters were estimated, EAP scores were calculated as the estimate of the index score, and transformed to a reporting scale of 0–20. The tables below show the response averages and transformed scale scores for each of the grade 8 civics indices. Note that response averages represent the average scored responses after score collapsing (if there was any collapsing). Each response average corresponds to one transformed score. The increment used for increases in the response average is determined by the number of items that form an index. For example, an index with four items would have response averages that increase by an increment of 1 / 4 or 0.25, while an index with five items would have response averages that increase by an increment of 1 / 5 or 0.20.

As a reporting aid, index scores were divided into a range of categories or classifications (e.g., low, moderate, high). The cut points selected to divide the index scores into meaningful categories were based on the distributions of the response average of each index.

As an example, for the index of persistence in learning, grade 8 students were classified as follows:

Students with a response average less than 2 were classified as low on the index. That is, students who on average responded closest to not at all like me on a question with the five response options not at all like me, a little bit like me, somewhat like me, quite a bit like me, and very much like me were classified as having a low level of persistence in learning.
Students with a response average greater than or equal to 2 to less than 3 were classified as having a moderate level of persistence in learning.
Finally, students with a response average greater than or equal to 3 were classified as high on the index. That is, students who on average responded closest to very much like me were classified as having a high level of persistence in learning.

Response averages and transformed scores for the index of eighth-grade students' persistence in learning, grade 8 civics PBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	5.9	2
	1.25	6.7	3
	1.50	7.3	3
	1.75	7.8	4
Moderate	2.00	8.2	6
	2.25	8.6	6
	2.50	9.0	8
	2.75	9.5	9
High	3.00	9.9	11
	3.25	10.4	11
	3.50	11.0	11
	3.75	11.8	12
	4.00	12.8	13
NOTE: PBA = Paper-based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response averages and transformed scores for the index of eighth-grade students' persistence in learning, grade 8 civics DBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	5.8	2
	1.25	6.7	2
	1.50	7.3	3
	1.75	7.8	5
Moderate	2.00	8.2	6
	2.25	8.7	6
	2.50	9.1	10
	2.75	9.5	8
High	3.00	10.0	12
	3.25	10.5	11
	3.50	11.1	12
	3.75	11.8	12
	4.00	12.8	12
NOTE: DBA = Digitally based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response averages and transformed scores for the index of eighth-grade students' academic self-discipline, grade 8 civics DBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	6.3	4
	1.25	7.2	4
	1.50	7.9	4
	1.75	8.4	6
Moderate	2.00	8.9	10
	2.25	9.3	9
	2.50	9.7	10
	2.75	10.1	10
High	3.00	10.6	11
	3.25	11.1	9
	3.50	11.6	9
	3.75	12.3	6
	4.00	13.3	6
NOTE: DBA = Digitally based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response averages and transformed scores for the index of eighth-grade students' enjoyment of complex problems, grade 8 civics DBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	6.7	11
	1.25	7.6	7
	1.50	8.3	6
	1.75	8.9	7
Moderate	2.00	9.3	11
	2.25	9.8	7
	2.50	10.2	8
	2.75	10.6	8
High	3.00	11.0	9
	3.25	11.5	6
	3.50	12.0	6
	3.75	12.7	5
	4.00	13.6	8
NOTE: DBA = Digitally based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response averages and transformed scores for the index of eighth-grade students' interest/enjoyment in civics, grade 8 civics DBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	6.4	9
	1.20	7.2	2
	1.40	7.8	4
	1.60	8.3	4
	1.80	8.7	5
	2.00	9.0	7
	2.20	9.4	5
	2.40	9.7	6
	2.60	9.9	6
	2.80	10.2	6
Moderate	3.00	10.5	12
	3.20	10.8	5
	3.40	11.1	5
	3.60	11.4	5
	3.80	11.7	4
High	4.00	12.0	5
	4.20	12.3	2
	4.40	12.7	2
	4.60	13.2	2
	4.80	13.7	1
	5.00	14.4	4
NOTE: DBA = Digitally based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response averages and transformed scores for the index of eighth-grade students' confidence in civics knowledge and skills, grade 8 civics DBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	5.1	4
	1.17	5.8	1
	1.33	6.3	1
	1.50	6.7	1
	1.67	7.1	1
	1.83	7.4	2
	2.00	7.7	4
	2.17	8.0	3
	2.33	8.3	3
	2.50	8.6	3
	2.67	8.9	4
	2.83	9.2	4
Moderate	3.00	9.5	14
	3.17	9.8	5
	3.33	10.1	7
	3.50	10.4	6
	3.67	10.7	6
	3.83	11.0	6
High	4.00	11.4	8
	4.17	11.7	4
	4.33	12.1	3
	4.50	12.5	3
	4.67	13.0	2
	4.83	13.6	1
	5.00	14.3	5
NOTE: DBA = Digitally based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response averages and transformed scores for the index of eighth-grade students' performance goals in civics, grade 8 civics DBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	6.3	7
	1.25	7.1	3
	1.50	7.7	4
	1.75	8.1	3
	2.00	8.5	8
	2.25	8.9	5
	2.50	9.2	6
	2.75	9.6	6
Moderate	3.00	9.9	13
	3.25	10.3	6
	3.50	10.6	7
	3.75	11.0	6
High	4.00	11.4	8
	4.25	11.8	3
	4.50	12.3	3
	4.75	12.9	3
	5.00	13.8	8
NOTE: DBA = Digitally based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response averages and transformed scores for the index of eighth-grade students' mastery goals in civics, grade 8 civics DBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	5.8	8
	1.25	6.6	2
	1.50	7.2	3
	1.75	7.7	3
	2.00	8.2	8
	2.25	8.6	5
	2.50	9.0	5
	2.75	9.4	5
Moderate	3.00	9.8	14
	3.25	10.2	5
	3.50	10.6	6
	3.75	11.0	5
High	4.00	11.5	10
	4.25	11.9	4
	4.50	12.4	3
	4.75	13.1	3
	5.00	13.9	11
NOTE: DBA = Digitally based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response averages and transformed scores for the index of eighth-grade students' views on community engagement, grade 8 civics PBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	6.3	5
	1.20	7.1	4
	1.40	7.7	4
	1.60	8.2	5
	1.80	8.6	6
	2.00	9.0	6
	2.20	9.3	7
	2.40	9.6	6
	2.60	9.9	6
	2.80	10.2	6
Moderate	3.00	10.4	8
	3.20	10.7	6
	3.40	11.0	6
	3.60	11.3	5
	3.80	11.6	5
High	4.00	11.9	4
	4.20	12.2	3
	4.40	12.6	3
	4.60	13.1	2
	4.80	13.6	2
	5.00	14.4	3
NOTE: PBA = Paper-based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Response averages and transformed scores for the index of eighth-grade students' views on community engagement, grade 8 civics DBA national assessment, by classification: 2018
Classification	Response average	Transformed score	Percentage of students
Low	1.00	6.0	4
	1.20	6.8	3
	1.40	7.4	3
	1.60	7.9	4
	1.80	8.3	4
	2.00	8.6	6
	2.20	8.9	6
	2.40	9.2	6
	2.60	9.5	6
	2.80	9.8	6
Moderate	3.00	10.1	11
	3.20	10.4	6
	3.40	10.7	6
	3.60	11.0	5
	3.80	11.3	5
High	4.00	11.6	5
	4.20	12.0	3
	4.40	12.4	3
	4.60	12.8	2
	4.80	13.4	2
	5.00	14.2	5
NOTE: DBA = Digitally based assessment. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2018 Civics Assessment.

Last updated 31 March 2025 (SK)

Printer-friendly Version

​​​​​​​​​​NAEP Technical DocumentationDevelopment of the 2018 Grade 8 Civics Indices

NAEP Technical DocumentationDevelopment of the 2018 Grade 8 Civics Indices