Treason and revenge: the emergence and continuation of ILSA contracting

Periodical
Critical Studies in Education
Year
2024
Page range
1-18
Relates to study/studies
ICCS 2009
ICCS 2016
ICILS 2013
ICILS 2018
PIRLS 2011
PIRLS 2016
PISA 2012
PISA 2015
PISA 2018
PISA-D
TALIS 2013
TIMSS 2011
TIMSS 2015
TIMSS 2019

Treason and revenge: the emergence and continuation of ILSA contracting

Abstract

OECD and IEA International Large-Scale Assessments (ILSAs) contractors have remained largely invisible despite playing a key role in the making of education assessment data. With the help of Bourdieu’s thinking, this paper analyses data generated through document analysis of ILSA Reports and in-depth interviews with staff working on ILSAs at the IEA, the OECD and ILSA contractors. The paper traces education assessment developments in the USA and at the IEA and the OECD since the 1980s, and points to the critical role of Education Testing Services (ETS). Although the selection of ILSA contractors ostensibly occurs through a globally competitive tendering process, this paper reveals the pressures and struggles that emerged when economic capital became available at the IEA and the OECD. The struggles reveal PISA was created as a competing project to TIMSS. The paper demonstrates how the social and cultural capitals that individuals acquired, and in particular trust, shaped who can and who cannot produce ILSA data today. Overall, the paper makes visible the ILSA data chefs and their recipes: ILSAs are not raw, they are cooked under pressure with personal and organizational tensions, struggles, conflicts, and emotional bonds.