This section outlines the procedure for printing student booklets and questionnaires for paper-based assessments. The National Assessment of Educational Progress (NAEP) is actively transitioning to full digital administration of assessments and questionnaires. While the primary emphasis is on completing questionnaires online via the NAEPq system, paper questionnaires continue to be utilized during the digitally based assessment process.
For prior NAEP paper-based assessment administrations and still used for Long Term Trend, the processing of materials began with the printing of student booklets and questionnaires. Printing preparations typically started with the design of the booklets, generally in the summer preceding the assessment. The design and development of digitally based student booklets and questionnaires are conducted separately by item development (ID) staff.
The development of paper-based assessment booklets was a collaborative effort involving multiple teams. Item development (ID) staff were responsible for developing both the assessment items and the associated instruments, including student booklets and questionnaires. Materials, distribution, processing, and scoring (MDPS) staff coordinated the receipt of content from ID staff, conducted reviews and edits, and combined approved blocks into complete booklets in accordance with established book maps.
A primary objective during early planning was to design a single format to be used consistently across all documents. This planning, including decisions related to paper booklet cover design, was typically finalized several months before the assessment administration.
For student booklets with new items, the item development staff create camera-ready blocks of items electronically and uploaded them to NAEP's Secure File Transfer Protocol (SFTP) site. MDPS staff downloaded these files and received a paper version of each block that reflected the intended page layout of text and artwork. Upon receipt, MDPS staff conducted an internal review to verify layout accuracy and overall presentation.
Any identified errors, questions, or suggested revisions were communicated back to ID staff for resolution. Minor changes were addressed by MDPS staff, while more extensive revisions were completed by ID staff and resubmitted as updated blocks. After each block successfully passed quality control review, the camera-ready version was forwarded to the MDPS printing facility.
Assessment instruments designed to measure trends across multiple assessment years were typically reprints of previously developed materials. In these cases, the MDPS printing facility rescanned a camera-ready copy from the prior administration, updated the block name, and incorporated the existing cognitive materials into the current year’s block template.
The assembly of complete student booklets and questionnaires began only after all required blocks had been received, reviewed, and approved for a given booklet, and after the Office of Management and Budget (OMB) approved the questionnaires for printing. ID staff provided booklet maps specifying the order of blocks, which the MDPS printing facility used—along with prior printed booklets as references—to assemble the electronic components into final booklets. Hard-copy proofs were then distributed to ID staff and NCES for review and approval. Following approval, the MDPS printing facility completed printing. Printed materials were subsequently sent to the MDPS secure warehouse for barcoding and bundling prior to distribution to sampling and data collection (SDC) field staff.