PIAAC requires in-person interviews to complete the background questionnaire, before administering the direct assessments (i.e., literacy, numeracy, component skills and/or problem solving in technology-rich environments). The direct assessments are available in two modes; paper-and-pencil and computer-administered. The design of the US-PIAAC survey includes the following instruments:
The overall direct assessment time is approximately 60 minutes. However, PIAAC is not a timed assessment and some participants may take longer to complete the assessment.
The assessment begins with a Background Questionnaire (BQ) . Among other things, the BQ asks about the participant's computer experiences, which is essential to route them to either taking the paper assessment or computer assessment. After completing the assessment, participants with no computer experience will be routed to the paper-based assessment, as will participants refusing to take the test on the computer. The remainder will be routed to the computer-based assessment (see Figure A).
Participants who perform well on both parts of the computer-based Core section will be randomly routed to the computer-based literacy , computer-based numeracy , or problem-solving domains. The computer-based assessment (CBA) consists of Module 1 and Module 2. Each module is a set of literacy, numeracy, or problem-solving units. Respondents who receive literacy or numeracy in CBA Module 1 will not repeat the same domain but instead receive one of the other two modules in CBA Module 2. Respondents who receive problem-solving in CBA Module 1 have a 50 percent chance of receiving a second set of problem-solving items again and a 50 percent chance of receiving literacy or numeracy items in CBA Module 2.
The diagram below is a simplified version of the workflow of the assessment with the paper-based assessment branching to the right and the computer-based assessment branching to the left. Note that within the computer-based assessment an adaptive design is used for the literacy and numeracy items in Modules 1 and 2.