SEA-PLM 2019 OUTCOME MEASURES
Assessment domain(s)
- Mathematical literacy
- Reading literacy
- Writing literacy
- Global citizenship
Achievement and test scales
Scale Creation
- SEA-PLM test items were scaled using item response theory (IRT) scaling methodology by means of a one-parameter Rasch model for dichotomous items and the partial credit model.
- Preliminary item calibrations were conducted separately by country. To ensure consistency of item parameters across countries measuring the underlying constructs for the 3 domains, an assessment of item fit, differential item functioning (DIF) by subgroup and item-country interaction analyses were conducted.
- Final item calibrations by domain were conducted using the full country samples and then weighted by senate weights. The student-weighted likelihood estimates (WLE) and plausible values (PVs) methodology were then used on finalized regional item lists to generate values for children’s knowledge by domain. Estimations were based on the conditional item response model and the population model, which includes the regression on student background and questionnaire variables used for conditioning.
- A conditioning three-dimensional model was built for each country. The principal components were estimated for each country separately. Subsequently, the components that explained 99% of the variance in all the original variables were included as regressors in the conditioning model.
- Scale scores of all countries for each domain were normalized to 300 points and the standard deviation to 30 points, with all countries being given equal weighting. On this basis, the scores of approximately 2 in 3 children are in a range of 270 points to 330 points.
- Each proficiency scale was divided into bands describing different levels of student proficiency.
- Alignment between SEA-PLM proficiency scales and SDG indicators: The content of the final SEA-PLM proficiency bands for reading and mathematics was matched with the expanded definition of SDG 4.1.1a and SDG 4.1.1b to select the most appropriate band corresponding to the international definitions.
List of Achievement Scales
- Mathematical literacy
- Reading literacy
- Writing literacy
Questionnaire and background scales
Scale Creation
- Item response modeling (applying the Rasch partial credit model) was used for creating background questionnaire scales.
- A composite index reflecting socioeconomic background was derived nationally, based on three parameters: the highest parental occupation of either parent, the highest educational level of either parent, and the home resources of the child’s family through the home resources scale.
List of Background Scales
Students
- Backgrounds
- Resources in the home
- Social-Economic Index (Nationally standardised)
- Attitudes/perceptions
- Positive attitudes towards school
- Attitudes towards mathematics
- Parental engagement towards schooling
- Global Citizenship
- Exposure to GC issues at school
- Asian identity
- Concern for global issues
- Expected civic behaviour
- Behavioural intentions associated with GC
- Attitudes towards learning about GC-related issues
Teachers
- Backgrounds
- Resources in the home
- Social-Economic Index (Nationally standardised)
- Attitudes/perceptions
- Confidence in teaching methods
- Community attitudes - Parents
- Community attitudes - Students
- Community attitudes - Teachers
- Teacher reports on student attitudes
- Issues affecting learning
- Global Citizenship
- Importance of learning about GC related issues - Teacher report
- Importance of developing GC skills - Teacher report
- Pre-teaching program GC skills - Teacher report
- Teaching confidence GC skills - Teacher report
- Mathematics teachers only - Confidence in teaching mathematics
School/Principals
- Backgrounds
- Resources in local area
- Attitudes/perceptions
- Issues hindering school capacity
- Community attitudes - Parents
- Community attitudes - Students
- Community attitudes - Teachers
- Frequency of issues occurring - among students