TIMSS 2019 OUTCOME MEASURES

Assessment domain(s)
  • Mathematics
  • Science
TOP
Achievement and test scales
Scale Creation

The TIMSS international achievement scales were developed on the basis of item response theory and latent regression population models using plausible values, with each student respondent being assigned five plausible values on each of the achievement scales.

Scale scores range from 0 to 1000.

Each international scale was established by TIMSS 1995 to have a midpoint of 500 located at the mean of the combined achievement distribution across all countries and 100 scale score points corresponding to one standard deviation of the combined distribution.

In order to measure trends over time, the results of all subsequent TIMSS assessments (1999, 2003, 2007, 2011, 2015, and 2019) were transformed into this metric.

With the dual administration mode (paperTIMSS and eTIMSS), the TIMSS scaling approach for 2019 involved additional psychometric analyses. Scaling the TIMSS 2019 achievement data proceeded in two phases:

  • Calibrating the paperTIMSS and bridge data on the TIMSS 2019 achievement scales
  • Linking the eTIMSS data to these scales via the bridge data

This process enabled the eTIMSS and paperTIMSS achievement results to be reported on the same achievement scale in each grade and subject.

 

List of Achievement Scales
  • Mathematics (Grade 4 and Grade 8)
  • Science (Grade 4 and Grade 8)
  • Content domains
    • Mathematics
      • Grade 4: number, measurement and geometry, data
      • Grade 8: number, algebra, geometry, data and probability
    • Science
      • Grade 4: life science, physical science, earth science
      • Grade 8: biology, chemistry, physics, earth science
  • Cognitive domains (Mathematics and Science, [Grades 4 and 8])
    • Knowing
    • Applying
    • Reasoning

Overall achievement results were reported in terms of the percentages of students reaching the following four benchmarks:

  • Advanced International Benchmark (625)
  • High International Benchmark (550)
  • Intermediate International Benchmark (475)
  • Low International Benchmark (400)

The descriptions of the competencies of students reaching each of these benchmarks were determined by means of a scale-anchoring process.

TOP
Questionnaire and background scales
Scale Creation

Many of the TIMSS 2019 context questionnaire items were developed to be combined into scales measuring a single underlying latent construct.

Scales were calculated using item response theory (IRT), specifically a Rasch partial credit model.

Each context scale allowed students to be classified into regions corresponding to high, middle, and low values on the construct. To facilitate interpretation of the regions, the cutpoints on the scale delimiting the regions were described in terms of combinations of response categories.

For certain scales that maintained many of the same items across TIMSS 2015 and TIMSS 2019, the scales were linked to allow for trend measurement on the background construct.

 

List of Background Scales

Questionnaire scales

  • Home environment support scales
    • Home Resources for Learning (Mathematics and Science, Grade 4)
    • Home Educational Resources (Mathematics and Science, Grade 8)
    • Home Early Literacy and Numeracy Activities Before Primary School (Mathematics and Science, Grade 4)
    • Could Do Literacy and Numeracy Tasks When Beginning Primary School (Mathematics and Science, Grade 4)
  • School composition and resources scales (Mathematics and Science, Grades 4 and 8)
    • School Composition by Socioeconomic Background of the Student Body
    • Schools Where Students Enter the Primary Grades with Literacy and Numeracy Skills
    • Instruction Affected by Mathematics Resource Shortages
    • Instruction Affected by Science Resource Shortages
  • School climate scales (Mathematics and Science, Grades 4 and 8)
    • School Emphasis on Academic Success – Principals’ Reports
    • Parents’ Perceptions of Their Child’s School
    • Student’s Sense of School Belonging
  • School discipline and safety scales (Mathematics and Science, Grades 4 and 8)
    • School Discipline
    • Safe and Orderly School – Teachers’ Reports
    • Student Bullying
  • Teacher preparation, professional development, and job satisfaction scales (Mathematics/Science, Grade 4 and 8)
    • Teachers’ Job Satisfaction
  • Challenges to teaching and learning scales (Mathematics and Science, Grade 4 and 8)
    • Classroom Teaching Limited by Students not Ready for Instruction
  • Students’ attitudes scales
    • Students Like Learning Mathematics/Science (Grades 4 and 8)
    • Students Confident in Mathematics/Science (Grades 4 and 8)
    • Students Value Mathematics/Science (Grade 8)
  • Curriculum and instruction scales (Grades 4 and 8)
    • Instructional Time Spent on Mathematics/Science
    • Percentages of Students Taught the TIMSS Mathematics/Science Topics
    • Instructional Clarity in Mathematics/Science Lessons – Students’ Reports
    • Disorderly Behavior During Mathematics Lessons
    • Teacher’s Emphasis on Science Investigation
TOP