PIAAC Cycle 1 OUTCOME MEASURES

Assessment domain(s)
  • Numeracy
  • Problem solving in technology-rich environments
  • Literacy
Achievement and test scales
Scale creation

The achievement scales were created using plausible values; these were drawn from a posteriori distribution by combining the IRT scaling of the cognitive items with a latent regression model using information from the BQ. Each adult respondent was assigned 10 plausible values in each of the achievement scales.

 
List of achievement scales

An overall achievement scale (literacy, numeracy, and problems solving in technology-rich environments) and separate scales for each of these three subdomains.

Scale scores range from 0 to 500.

Overall achievement and results for literacy and numeracy are usually reported in reference to the following 7 international benchmarks:

  • Below level 1 (0–175)
  • Level 1 (176–225)
  • Level 2 ( 226–275)
  • Level 3 (276–325)
  • Level 4 (326–375)
  • Level 5 (376–500)

As there were fewer problem-solving items (14 items) than items from the other domains (2 x 76 items), and the problem-solving items were more difficult, only 4 levels were defined for this domain:

  • Below Level 1 (0–240)
  • Level 1 (241–290)
  • Level 2 (291–340)
  • Level 3 (341–500)
Questionnaire and background scales
Scale creation

The database contains several scales computed using subsets of background questions. Scales were calculated using item response theory (IRT). In addition, categorical variables were created using these scales by classifying respondents into quintiles.

 
List of background scales

ICT at home (7 items)

  • Using e-mail
  • Using Internet
  • Using spreadsheets
  • Using word processors
  • Conducting transactions on line
  • Using programming language
  • Participating in online discussions (conferences, chats)

 

ICT at work (7 items)

  • Using e-mail
  • Using Internet
  • Using spreadsheets
  • Using word processors
  • Conducting transactions on line
  • Using programming language
  • Participating in online discussions (conferences, chats)

 

Influence (7 items)

  • Instructing
  • Teaching or training people
  • Making speeches or presentations
  • Advising people
  • Planning others’ activities
  • Persuading or influencing others
  • Negotiating

 

Learning at work (3 items)

  • Learning new things from supervisors or co-workers
  • Learning-by-doing
  • Keeping up-to-date with new products or services.

 

Numeracy at home (6 items)

  • Calculating prices, costs or budgets
  • Using fractions, decimals, or percentages
  • Using calculators
  • Preparing graphs or tables
  • Using algebra or formulas
  • Using advanced math or statistics

 

Numeracy at work (6 items)

  • Calculating prices, costs or budgets
  • Using fractions, decimals, or percentages
  • Using calculators
  • Preparing graphs or tables
  • Using algebra or formulas
  • Using advanced math or statistics

 

Planning (3 items)

  • How often - Planning own activities
  • How often - Planning others’ activities
  • How often - Organizing own time

 

Reading at home (8 items)

  • Reading directions or instructions
  • Reading letters, memos, or  e-mail
  • Reading newspapers or magazines
  • Reading professional journals or publications
  • Reading books
  • Reading manuals or reference materials
  • Reading financial statements
  • Reading diagrams, maps, or schematics

 

Reading at work (8 items)

  • Reading directions, or instructions
  • Reading letters, memos, or  e-mail
  • Reading newspapers or magazines
  • Reading professional journals or publications
  • Reading books
  • Reading manuals or reference materials
  • Reading financial statements
  • Reading diagrams, maps, or schematics

 

Readiness to learn (6 items)

  • Learning strategies - Relate new ideas into real life
  • Learning strategies - Like learning new things
  • Learning strategies - Attribute something new
  • Learning strategies - Get to the bottom of difficult things
  • Learning strategies - Figure out how different ideas fit together
  • Learning strategies - Looking for additional information

 

Task discretion (4 items)

  • Work flexibility - Sequence of tasks
  • Work flexibility - How to do the work
  • Work flexibility - Speed of work
  • Work flexibility - Working hours

 

Writing at home (4 items)

  • Write letters, memos, or e-mail
  • Write articles
  • Write reports
  • Fill in forms

 

Writing at work (4 items)

  • Write letters, memos, or e-mail
  • Write articles
  • Write reports
  • Fill in forms