PIAAC Cycle 2 Design
Methodology
Quantitative Study
Method(s)
- Cross-sectional assessment and survey
- Trend study
Target population
- Non-institutionalized individuals aged 16 to 65 who are residents in the participating country/economy.
- Countries/economies were permitted to extend the target population.
- The target population covered all residents regardless of citizenship, nationality, and language.
- Adults in institutional collective dwelling units, such as prisons, hospitals, nursing homes, military barracks, and military bases, were not included.
Sample design
- A probability-based sample, which should be representative of the target population of the country/economy
- The following PIAAC standards were communicated to participating countries/economies. A typical sample design consists of:
- A stratified multistage clustered area sample for geographically large countries/economies
- Less clustering and fewer stages of sampling for geographically small countries/economies
- Each country/economy was permitted to select a sample design in line with the PIAAC standards.
- National sample designs as decided by countries/economies
Sample size
4,500 (for the main language of the country)
Data collection techniques and instruments
- Background questionnaire administered in a computer-assisted personal interview (CAPI) format by the interviewer
- Assessment test as computer self-assessment under supervision of the interviewer (adaptive test design)
Languages
- Administration of the background questionnaire in 29 languages
- Administration of the assessment in 25 languages
Translation procedures
- Development of an international version of all assessment instruments in English
- Translation into applicable languages of instruction by participating entities (national centers); guidance and assistance provided to countries throughout the process by the PIAAC Consortium, by developing and conducting linguistic quality control (LQC) processes
- Translation verification by linguistic and assessment experts in order to ensure equivalence to the international version
Quality control of operations
Measures during data collection
- General note: Participants were responsible for data collection within their own territories.
- Provision of a set of technical standards and guidelines (TSG) for survey/operations/data collection
- Provision of software tools for supporting activities
- Provision of dashboards with progress and quality indicators
- Quality control monitoring with continuous support to countries in accordance with the TSG (standardized forms and reports to be completed at each step of the data collection, regular communication, etc.)
- Training program produced by the Consortium (data management training, interviewer training, etc.)
Measures during data processing and cleaning (using SQL-based cleaning programs)
- Standardized cleaning process at the national level (using IEA DME software)
- Recoding, cleaning, and editing at the national level as discussed with and approved by the Consortium
- Data processing at the international level by the Consortium
- Repetition of data cleaning and comparison of new data sets with preceding version
- Iterative process of data review and correction within the Consortium, the participating countries, and the OECD Secretariat
Sources - Technical documentation
Other sources