Psychometric and technological analysis of a competence assessment test. The PIRLS model using structural equations.
DOI:
https://doi.org/10.51660/ripie.v1i1.26Keywords:
Evaluation, Technology, PIRLS, Reading literacy, TestAbstract
The development of reading literacy, as a vital capacity for the growth and maturation of students, has assumed a fundamental role in the educational environment. In this line, different scientific studies aims to measure such competition worldwide, as well as the factors associated with their acquisition: one of these studies is PIRLS, a study by the IEA that assesses reading literacy of students in 4th of Primary Education. This article aims to study the characteristics and psychometric behavior of 16 items released by the IEA belonging to one of the PIRLS tests: "The Green Sea Turtle's Journey of a Lifetime ". For this purpose, a descriptive approach research is carried out. A sample of 2397 Spanish students have made the test, which has been examined with different procedures of statistical exploration thanks to different computer software: SPSS and PARAM. The results show different degrees of difficulty and discrimination in the items. Likewise, the unidimensionality of the subtest is verified, which measures the level of reading competence to acquire and use information. In addition, the importance of using tests with reliable foundations that endorse their use is underlined.
Downloads
References
Anderson, R. & Pearson, P. (1984). A schema-theoretic view of basic processes in reading comprehension. Longman.
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinees's ability. Addison-Wesley.
Cabero-Almenara, J., Barroso-Osuna, J., Palacios-Rodríguez, A., y Llorente-Cejudo, C. (2020a). Marcos de Competencias Digitales para docentes universitarios: su evaluación a través del coeficiente competencia experta. Revista Electrónica Interuniversitaria De Formación Del Profesorado, 23(2). https://doi.org/10.6018/reifop.413601 DOI: https://doi.org/10.6018/reifop.413601
Cabero-Almenara, J., Romero-Tena, R., y Palacios-Rodríguez, A. (2020b). Evaluation of Teacher Digital Competence Frameworks Through Expert Judgement: the Use of the Expert Competence Coefficient. Journal of New Approaches in Educational Research, 9(2), 275-293. http://dx.doi.org/10.7821/naer.2020.7.578 DOI: https://doi.org/10.7821/naer.2020.7.578
Cabero-Almenara, J., y Palacios-Rodríguez, A. (2019). Marco Europeo de Competencia Digital Docente «DigCompEdu». Traducción y adaptación del cuestionario «DigCompEdu Check-In». EDMETIC, 9(1), 213-234. https://doi.org/10.21071/edmetic.v9i1.12462 DOI: https://doi.org/10.21071/edmetic.v9i1.12462
Chall, J. (1983). Stages of reading development. McGraw-Hill.
Colomo, E., Gabarda, V., Cívico, A., & Cuevas, N. (2020). Percepción de estudiantes sobre el uso del videoblog como recurso digital en educación superior. Píxel-Bit. Revista De Medios Y Educación, 59, 7-25. https://doi.org/10.12795/pixelbit.74358 DOI: https://doi.org/10.12795/pixelbit.74358
Donnelley, R.R. (2011) Curriculum for excellence building the curriculum5: a framework for assessment: executive summary. Scottish Government.
Elley, W. (1992). How in the world do students read? International Association for the Evaluation of Educational Achievement (IEA).
Elley, W. (1994). The IEA study of reading literacy: Achievement and instruction in thirty-two school systems. Elsevier Science Ltd.
Elosúa, M., García-Madruga, J., Gómez- Veiga, & Felski, R. (2008). Uses of literature. Blackwell.
Gross, B. & Humphreys, S. (1985). Evaluating intervention programs: applications from women’s programs in math and science. Teachers College.
I., López- Escribano, C., Perez, E., & Orjales, I. (2012). Habilidades Lectoras y rendimiento académico en 3° y 6° de primaria: aspectos evolutivos y educativos. Estudios de Psicología, 33(2), 207-218. DOI: https://doi.org/10.1174/021093912800676411
INEE (2017). PIRLS Estudio internacional de progreso en comprensión lectora Informe español. Secretaría General Técnica.
Kintsch, W. (1998). Comprehension: A paradigm for cognition. Cambridge University Press.
Kintsch, W. (2012). Psychological models of reading comprehension and their implications for assessments. Rowman & Littlefield Publishers.
Kintsch, W. (2013). Revisiting the construction-integration model of text comprehension and its implications for Instruction. International Reading Association. DOI: https://doi.org/10.1598/0710.32
Literatura (2018). En Diccionario de la lengua española. Recuperado de http://dle.rae.es/?id=NR70JFl
Literatura (2018). En Oxford Dictionary. Recuperado de https://es.oxforddictionaries.com/definicion/literatura
Lord, F. (1980). Applications of Item Response Theory to Practical Testing Problems. Erlbaum.
Lord, F. M. (1952). A theory of mental test scores. Psychometric Society.
Maneesriwongul, W. & Dixon, J.K. (2004). Instrument translation process: a methods review. Journal of advanced Nursing, 48(2), 175-186. DOI: https://doi.org/10.1111/j.1365-2648.2004.03185.x
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometriha, 47, 149-174. DOI: https://doi.org/10.1007/BF02296272
Matute, E., Roselli, M., Ardila, A., & OstroskySolis, F. (2007). Evaluación Neuropsicológica Infantil (ENI). Manual Moderno.
Mullis I. & Martin M. (2015). PIRLS Assessment Framework, 2n edition. International Association for the Evaluation of Educational Achievement (IEA). TIMSS & PIRLS International Study Center.
Mullis, I., Martin, M. & Hooper, M. (2017). Methods and Procedures in PIRLS. International Association for the Evaluation of Educational Achievement (IEA). TIMSS & PIRLS International Study Center.
Mullis, I., Martin, M., Foy, P. & Hooper, M. (2017). PIRLS, International Results in Reading. International Association for the Evaluation of Educational Achievement (IEA). TIMSS & PIRLS International Study Center.
Renom, J. (1993). Tests adaptativos computerizados. Fundamentos y aplicaciones. PPU.
Romero-Tena, R., Barragán-Sánchez, R., Llorente-Cejudo, C., & Palacios-Rodríguez, A. (2020). The Challenge of Initial Training for Early Childhood Teachers. A Cross Sectional Study of Their Digital Competences. Sustainability, 12, 4782. https://doi.org/10.3390/su12114782 DOI: https://doi.org/10.3390/su12114782
Rosselli, M., Matute, E., & Ardila, A. (2006). Predictores neuropsicológicos de la lectura en española. Revista de Neurología, 42(4), 202-210. DOI: https://doi.org/10.33588/rn.4204.2005272
Ruddell, R. & Unrau, N. (2004). Read as a meaning-construction process: The reader, the text, and the teacher. International Reading Association.
Rueda, M. I. (2003). La lectura: Adquisición, dificultades e intervención (2a Ed.). Amarú Ediciones.
Slager, M. G. (2010). A comparative study into the literature curricula in secondary education in six European countries. Groningen editorial.
Suggate, S. P. (2014). A Meta-Analysis of the Long-Term Effects of Phonemic Awareness, Phonics, Fluency, and Reading Comprehension Interventions. Journal of Learning Disabilities. Advance online publication, 3, 44-65.
Thompson, G.B., Fletcher-Flinn, C. M., Wilson, K. J., McKay, M. F., & Margrain, V. G. (2015). Learning with sublexical information from emerging reading vocabularies in exceptionally early and normal reading development. Cognition, 136, 166-185. DOI: https://doi.org/10.1016/j.cognition.2014.11.032
Downloads
Published
Issue
Section
License
Copyright (c) 2021 Revista Internacional de Pedagogía e Innovación Educativa
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Articles are published under the terms of a licence that permits use, distribution and reproduction in any medium, provided that the original work is properly cited. Ed&TIC retains the proprietary rights to the published works and actively promotes the reuse of these works under the terms of the aforementioned licence, which encourages the dissemination of knowledge and collaboration in the academic community.
