The Korea Society Of Educational Studies In Mathematics

Current Issue

Journal of Educational Research in Mathematics - Vol. 30 , No. 2

[ Article ]
Journal of Educational Research in Mathematics - Vol. 30, No. 2, pp.177-197
Abbreviation: JERM
ISSN: 2288-7733 (Print) 2288-8357 (Online)
Print publication date 31 May 2020
Received 08 Mar 2020 Revised 07 May 2020 Accepted 07 May 2020
DOI: https://doi.org/10.29275/jerm.2020.05.30.2.177

Analysis of the Korean PISA Survey Results in Mathematics Using the Anchoring Vignettes Method
Jung, Hyekyung* ; Rim, Haemee**,
*Professor, Korea University of Technology and Education, South Korea (hjung@koreatech.ac.kr)
**Professor, Kongju National University, South Korea (rimhaemee@kongju.ac.kr)

Correspondence to : Professor, Kongju National University, South Korea, rimhaemee@kongju.ac.kr


Abstract

The anchoring vignettes method as an alternative to the questionnaire using the Likert scale was newly applied to the student survey in the 2012 Programme for International Student Assessment (PISA). The three levels of vignettes (high, medium, and low levels) were included in the student survey related to ‘Teacher Support’ and ‘Classroom Management’ in mathematics, the main domain in the PISA 2012. Based on responses to the vignette questions, the PISA provided adjusted scaled scores for 12 student survey constructs. This study re-visited the responses of the vignettes as well as the relevant survey constructs, particularly focusing on the Korean students. The study findings can provide meaningful implications for understanding the response patterns for the Korean students on attitudes toward mathematics and developing survey tools using vignettes.


Keywords: anchoring vignettes, PISA, mathematics affective domains, survey items

References
1. Bertling, J. P. and P.C. Kyllonen (2013). “Using anchoring vignettes to detect and correct for response styles in PISA questionnaires”. Prenzel, M. (Chair), The Attitudes-Achievement-Paradox: How to Interpret Correlational Patterns in Cross-Cultural Studies, Invited Symposium at the EARLI 2013, Munich, Germany.
2. Hamamura, T., Heine, S. J., & Paulhus, D. L. (2008). Cultural differences in response styles: The role of dialectical thinking. 44(4), 932-942.
3. He, J., Buchholz, J., & Klieme, E. (2017). Effects of anchoring vignettes on comparability and predictive validity of student self-reports. 64 cultures. Journal of Cross-Cultural Psychology, 48(3), 319-334.
4. Hopkins, D. J., & King, G. (2010). Improving anchoring vignettes: Designing surveys to correct interpersonal incomparability. Public opinion quarterly, 74(2), 201-222.
5. Kapteyn, A., Smith, J. P., & Van Soest, A. (2007). Vignettes and self-reports of work disability in the United States and the Netherlands. American Economic Review, 97(1), 461-473.
6. King, G., & Wand, J. (2007). Comparing incomparable survey responses: Evaluating and selecting anchoring vignettes. Political Analysis, 15(1), 46-66.
7. King, G., Murray, C. J., Salomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American political science review, 98(1), 191-207.
8. Kwon, O.S., Seo, Y., & Jung, J. H. (2012). An Analysis of the Willingness to Contribute to Public Agricultural R&D Fund : An Anchoring Vignette Method. The Korean Journal of Agricultural Economics, 53(4), 19-41.
9. OECD (2009). PISA data analysis manual: SAS 2nd edition. PISA, OECD publishing, Paris.
10. OECD (2013). PISA 2012 Results: Ready to Learn - Students’ Engagement, Drive and Self-Beliefs (Volume III). PISA, OECD Publishing.
11. OECD (2014). PISA 2012 Technical Report. PISA, OECD publishing, Paris.
12. O'Neill, H. (1967). Response style influence in public opinion surveys. The Public Opinion Quarterly, 31(1), 95-102. Retrieved from www.jstor.org/stable/2746887.
13. Paulhus, D. L. (1991). Measurement and control of response bias. J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 17-59). San Diego, CA: Academic Press.
14. Primi, R., Zanon, C., Santos, D., De Fruyt, F., & P. John, O. (2016). Anchoring vignettes. Can they make adolescent self-reports of social-emotional skills more reliable, discriminant, and criterion-valid? European Journal of Psychological Assessment, 32(1), 39-51.
15. van Herk, H., Poortinga, Y. H., & Verhallen, T. M. M. (2004). Response styles in rating scales: Evidence of method bias in data from 6 EU countries. Journal of Cross-Cultural Psychology, 35(3), 346-360.
16. Von Davier, M., Shin, H., Khorramdel, L., & Stankov, L. (2017). The effects of vignette scoring on reliability and validity of self-reports. Applied Psychological Measurement, 1-16.