Table of Contents | Search Technical Documentation | References
The full sample of students is divided into 10 equivalent groups, and each group of students is assigned one of the 10 test booklets. In this design, each cognitive block appears twice in each of the two possible positions, and each block is paired once with every other block (see Messick, Beaton, and Lord 1983). (This example shows only the cognitive blocks, even though the test booklets also contain background blocks.)
Booklet version | Position 1 cognitive block | Position 2 cognitive block |
---|---|---|
1 | A | B |
2 | B | C |
3 | C | D |
4 | D | E |
5 | E | A |
6 | A | C |
7 | B | D |
8 | C | E |
9 | D | A |
10 | E | B |
NOTE: Each block appears 4 times in this group of booklets. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP). |
Cognitive block | Position 1 | Position 2 |
---|---|---|
A | 2 | 2 |
B | 2 | 2 |
C | 2 | 2 |
D | 2 | 2 |
E | 2 | 2 |
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP). |
Items | A | B | C | D | E |
---|---|---|---|---|---|
A | † | ||||
B | 1 | † | |||
C | 1 | 1 | † | ||
D | 1 | 1 | 1 | † | |
E | 1 | 1 | 1 | 1 | † |
† Not applicable. Any given block never appears twice in the same booklet. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP). |
View the booklet designs for each subject area.