The impact of test language on PISA scores

Periodical
British Educational Research Journal
Volume
48
Year
2022
Issue number
3
Page range
420-445
Relates to study/studies
PISA 2015
PISA 2018

The impact of test language on PISA scores

New evidence from Wales

Abstract

In this paper we investigate the link between the language in which pupils take the Programme for International Student Assessment (PISA) test and the scores they achieve in this assessment, focusing upon the case of Wales. Using five rounds of PISA data and an instrumental variable approach, we show how pupils who took the test in Welsh score around 0.3 standard deviations (30 PISA test points) lower in reading, mathematics and science than their peers who took the test in English. This finding is robust to different model specifications and statistical approaches. We argue that this may indicate that the academic performance of teenagers in Wales may be underestimated in PISA—particularly amongst those who take this test in Welsh.