PIAAC Cycle 2 Design

Methodology
Quantitative Study
TOP
Method(s)
  • Cross-sectional assessment and survey 
  • Trend study
TOP
Target population
  • Non-institutionalized individuals aged 16 to 65 who are residents in the participating country/economy.
  • Countries/economies were permitted to extend the target population.
  • The target population covered all residents regardless of citizenship, nationality, and language.
  • Adults in institutional collective dwelling units, such as prisons, hospitals, nursing homes, military barracks, and military bases, were not included.
TOP
Sample design
  • A probability-based sample, which should be representative of the target population of the country/economy
  • The following PIAAC standards were communicated to participating countries/economies. A typical sample design consists of:
    • A stratified multistage clustered area sample for geographically large countries/economies
    • Less clustering and fewer stages of sampling for geographically small countries/economies
  • Each country/economy was permitted to select a sample design in line with the PIAAC standards.
  • National sample designs as decided by countries/economies
TOP
Sample size

4,500 (for the main language of the country)

TOP
Data collection techniques and instruments
  • Background questionnaire administered in a computer-assisted personal interview (CAPI) format by the interviewer
  • Assessment test as computer self-assessment under supervision of the interviewer (adaptive test design)
TOP
Languages
  • Administration of the background questionnaire in 29 languages
  • Administration of the assessment in 25 languages
TOP
Translation procedures
  • Development of an international version of all assessment instruments in English
  • Translation into applicable languages of instruction by participating entities (national centers); guidance and assistance provided to countries throughout the process by the PIAAC Consortium, by developing and conducting linguistic quality control (LQC) processes
  • Translation verification by linguistic and assessment experts in order to ensure equivalence to the international version
TOP
Quality control of operations

Measures during data collection

  • General note: Participants were responsible for data collection within their own territories.
  • Provision of a set of technical standards and guidelines (TSG) for survey/operations/data collection
  • Provision of software tools for supporting activities
  • Provision of dashboards with progress and quality indicators
  • Quality control monitoring with continuous support to countries in accordance with the TSG (standardized forms and reports to be completed at each step of the data collection, regular communication, etc.)
  • Training program produced by the Consortium (data management training, interviewer training, etc.)

 

Measures during data processing and cleaning (using SQL-based cleaning programs)

  • Standardized cleaning process at the national level (using IEA DME software)
  • Recoding, cleaning, and editing at the national level as discussed with and approved by the Consortium
  • Data processing at the international level by the Consortium
  • Repetition of data cleaning and comparison of new data sets with preceding version
  • Iterative process of data review and correction within the Consortium, the participating countries, and the OECD Secretariat
TOP
Sources - Technical documentation
TOP
Other sources
TOP