Keywords
University Student
Multiple Choice Test
Reading
Comprehension
Evaluación del estudiante
Estudiante universitario
Prueba de respuesta múltiple
Lectura
Comprensión
How to Cite
Abstract
The goal of this article is to provide evidence as to the validity and reliability of a new Reading Comprehension test aimed at college students which is based on an observational and cross-cutting research design. The test was taken by 244 students in the first year of their major. The results were analyzed according to the Classical Test Theory, the Rasch Model and a Pearson correlation coefficient to compare the scores obtained with first year courses taken by students for their Major. As a result of the study, a 44-item was elaborated with a reliability scale of 0.74 and a statistically significant correlation scores of 0.21 [0.09, 0.33] (p < 0.000) for student grades in first-year courses. It can be concluded that this test could be useful to detect reading comprehension difficulties among first-year university students which could potentially negatively impact their academic performance. The test could also serve as a screening tool in the development of remedial programs to strengthen reading comprehension among these students.
References
Alderson, J. C. (2000). Assessing Reading. Reino Unido: Cambridge University Press.
Alexander, P. A. y Fox, E. (2013). A Historical Perspective on Reading Research and Practice, Redux. En D. E. Alvermann, N. J. Unrau y R. B. Ruddell (Eds.), Theoretical Models and Processes of Reading (pp. 3-46). Estados Unidos: International Reading Association.
Alvermann, D. E., Unrau, N. J. y Ruddell, R. B. (2013). Theoretical Models and Processes of Reading. Estados Unidos: International Reading Association.
Bachman, L. F. (2007). What is the construct? The dialectic of abilities and contexts in defining constructs in language assessment. En J. Fox, M. Wesche, D. Bayliss, L. Cheng, C. E. Turner y C. Doe (Eds.), Language Testing Reconsidered (pp. 41-71). Canadá: University of Ottawa Press.
Berko, J., Vellutino, F. y Wolf, M. (1999). Una explicación psicolingüística de la lectura. En J. Berko y B. Bernstein (Eds.), Psicolingüística (pp.433-475). España: MacGraw Hill.
Camps, A. y Colomer, T. (1996). Enseñar a leer, enseñar a comprender. España: Celeste/M.E.C.
Cassany, D. (2006). Tras las líneas. España: Anagrama.
Cerdán, R., Vidal, E., Martínez, T., Gilabert, R. y Gil, L. (2009). Impact of question-answering tasks on search processes and reading comprehension. Learning and Instruction, 19(1), 13-27.
Cruz, J. (2018). Tests estandarizados de comprensión lectora [Mensaje en un blog]. Comprensión lectora basada en evidencias. Recuperado de https://clbe.wordpress.com/tests-estandarizados-de-comprension-lectora/
Davis, F. B. (1944). Fundamental factors of comprehension in reading. Psychometrika, 9(3), 185-197.
Day, R. y Bamford, J. (1998). Extensive reading in the second language classroom. Estados Unidos: Cambridge University Press.
Farr, R., Pritchard, R. y Smitten, B. (1990). A description of what happens when an examinee takes a multiple‐choice reading comprehension test. Journal of Educational Measurement, 27(3), 209-226.
Fletcher, J. M. (2006). Measuring reading comprehension. Scientific Studies of Reading, 10(3), 323-330.
Gutiérrez, M. (1999). Inferencias en la comprensión del lenguaje. En M. Vega y F. Cuetos (Eds.), Psicolingüística del español (pp. 231-270). España: Editorial Trotta.
Jackson, N. E. (2005). Are university students' component reading skills related to their text comprehension and academic achievement? Learning and Individual Differences, 15(2), 113-139.
Keenan, J. M., Betjemann, R. S. y Olson, R. K. (2008). Reading comprehension tests vary in the skills they assess: Differential dependence on decoding and oral comprehension. Scientific Studies of Reading, 12(3), 281-300.
Kendeou, P., van den Broek, P., Helder, A. y Karlsson, J. (2014). A cognitive view of reading comprehension: implications for reading difficulties. Learning Disabilities Research & Practice, 29(1), 10-16.
Kintsch, W. (2013). Revisiting the Construction-Integration Model of Text Comprehension and Its Implications for Instruction. En D. E. Alvermann, N. J. Unrau y R. B. Ruddell (Eds.), Theoretical Models and Processes of Reading (pp. 807 - 839). Estados Unidos: International Reading Association.
Landi, N. (2010). An examination of the relationship between reading comprehension, higher level and lower-level reading sub-skills in adults. Reading and writing, 23(6), 701-717.
Leighton, J. P. y Gierl, M. J. (2011). The learning sciences in educational assessment: the role of cognitive models. Estados Unidos: Cambridge University Press.
Leslie, L. y Caldwell, J. (2009). Formal and Informal Measures of Reading Comprehension. En S. E. Israel y G. G. Duffy (Eds.), Handbook of research on reading comprehension (pp. 403-427). Estados Unidos: Routledge.
Linacre, J. M. (2018). Winsteps® Rasch measurement computer program. Beaverton, Oregon: Winsteps.com
Lloréns, A. C., Gil, L., Abarca, E.V., Martínez, T., Mañá. A. y Gilabert, R. (2011). Prueba de Competencia Lectora para Educación Secundaria (CompLEC). Psichotema, 23(4), 808-817.
López, M. (2010). Estrategias cognitivas del aprendizaje y comprensión lectora en estudiantes de quinto grado de secundaria de una institución educativa del Callao [Tesis de maestría]. Universidad de Costa Rica, San José. Recuperado de https://bit.ly/30rlmdX
Magliano, J. P., Millis, K. K., Ozuru, Y. y McNamara, D. S. (2007). A multidimensional framework to evaluate reading assessment tools. En D. McNamara (Ed.), Reading comprehension strategies: Theories, interventions, and technologies (pp. 107-136). Estados Unidos: Lawrence Erlbaum Associates.
McNamara, D. y Magliano, J. (2009). Towards a comprehensive model of comprehension. En B. Ross (Ed.), The psychology of learning and motivation (pp. 297-384). Estados Unidos: Academic Press.
Montero, E., Rojas, S., Zamora, E. y Rodino, M. (2011). Costa Rica en las pruebas PISA 2009 de Competencia Lectora y Alfabetización Matemática. San José, Costa Rica: CONARE. Recuperado de https://bit.ly/2JNLrOs
Muñiz, J. (2018). Introducción a la psicometría / Teoría clásica y TRI. España: Ediciones Pirámide.
O’Reilly, T., Weeks, J., Sabatini, J., Halderman, L. y Steinberg, J. (2014). Designing reading comprehension assessments for reading interventions: how a theoretically motivated assessment can serve as an outcome measure. Educational Psychology Review, 26(3), 403-424.
Organización para la Cooperación y el Desarrollo Económico. (2000). Programme for International student Assessment. Reading, mathematical and scientific literacy. París: OECD.
Ozuru, Y., Rowe, M., O’Reilly, T. y McNamara, D. S. (2008). Where’s the difficulty in standardized reading tests: The passage or the question? Behavior Research Methods, 40(4), 1001-1015.
Pérez, M. J. (2005). Evaluación de la comprensión lectora: Dificultades y limitaciones. Revista de Educación, 1, 121-138.
Perfetti, C. y Adlof, S.M. (2012). Reading Comprehension: A Conceptual Framework from Word Meaning to Text Meaning. En J. P. Sabatini, E. R. Albro y T. O’Reilly, Measuring Up: advances in how we asses Reading ability (pp. 3-20). EstadosUnidos: Rowman & Littlefield Education.
R Core Team. (2018). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Recuperado de http://www.R-project.org/
Reyes, S., Castillo, A., Zúñiga, A. y Llarena, R. (2009). La evaluación objetiva de la habilidad lectora en la educación media superior. México: CENEVAL. Recuperado de https://bit.ly/2RH0dZw
Rupp, A. A., Ferne, T. y Choi, H. (2006). How assessing reading comprehension with multiple-choice questions shapes the construct: A cognitive processing perspective. Language testing, 23(4), 441-474.
Solé, I. (2009). Estrategias de lectura. España: Editorial Graó.
Svetina, D., Gorin, J. S. y Tatsuoka, K. K. (2011). Defining and comparing the reading comprehension construct: A cognitive-psychometric modeling approach. International Journal of Testing, 11(1), 1-23.
Van den Broek, P. (2012). Individual and Developmental Differences in Reading Comprehension: Assessing Cognitive Processes and Outcomes. En J. P. Sabatini, E. R. Albro y T. O’Reilly, Measuring Up: advances in how we asses Reading ability (pp. 39 - 57). Estados Unidos: Rowman & Littlefield Education.
Willse, J. (2018). CTT / Classical Test Theory Functions. Recuperado de https://CRAN.R-project.org/package=CTT
Wright, B. D. y Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3). Recuperado de https://www.rasch.org/rmt/rmt83b.htm