Validity of a reading comprehension test for Portuguese students

  1. Cadime, Irene
  2. Ribeiro, Iolanda
  3. Viana, Fernanda Leopoldina P.
  4. Santos, Sandra
  5. Prieto Adánez, Gerardo
  6. Maia, José
Revista:
Psicothema

ISSN: 0214-9915

Año de publicación: 2013

Volumen: 25

Número: 3

Páginas: 384-389

Tipo: Artículo

Otras publicaciones en: Psicothema

Resumen

Antecedentes: el objetivo de este trabajo fue recoger evidencia de validez de constructo y de criterio para un test de comprensión lectora (TCL- Teste de Compreensão da Leitura) con tres versiones escaladas verticalmente para evaluar alumnos portugueses de segundo, tercero y cuarto cursos de Primaria. Método: se efectuaron dos estudios. En el primero (n= 1,229) se analizó la dimensionalidad de la prueba recurriendo al análisis factorial confirmatorio. En el segundo (n= 402) se proporcionan datos sobre evidencia de validez concurrente y predictiva, analizando las correlaciones entre los resultados en TCL, los resultados en otras pruebas de lectura y los resultados académicos. Resultados: los análisis factoriales confirmatorios revelaron que el modelo de un factor se ajusta a los datos. Se obtuvieron coeficientes de correlación bajos a moderados y estadísticamente significativos entre las puntuaciones en el TCL y en otros tests de lectura. Las puntuaciones en TCL predijeron las puntuaciones obtenidas por los alumnos en los exámenes nacionales de lengua portuguesa y en las competencias de comprensión evaluadas por los maestros. Conclusiones: estos resultados proporcionan evidencia empírica para la validez de las versiones de TCL.

Referencias bibliográficas

  • American Educational Research Association (AERA) (1999). Standards for educational and psychological testing. Washington, DC: AERA.
  • Barrett, T. (1976). Taxonomy of reading comprehension. In R. Smith & T. Barrett (Eds.), Teaching reading in the middle class (pp. 51-58). Boston, MA: Addison-Wesley.
  • Basaraba, D., Yovanoff, P., Alonzo, J., & Tindal, G. (2013). Examining the structure of reading comprehension: Do literal, inferential, and evaluative comprehension truly exist? Reading and Writing, 26(3), 349-379.
  • Best, R.M., Floyd, R.G., & Mcnamara, D.S. (2008). Differential competencies contributing to children's comprehension of narrative and expository texts. Reading Psychology, 29(2), 137-164.
  • Brown, T. (2006). Confi rmatory factor analysis for applied research. New York: The Guilford Press.
  • Byrne, B. (2011). Structural equation modeling with Mplus: Basic concepts, applications and programming. New York: Routledge Academic.
  • Català, G., Català, M., Molina, E., & Monclús, R. (2001). Evaluación de la comprensión lectora: Pruebas ACL [Assessment of reading comprehension: ACL tests]. Barcelona: Editorial Graó.
  • Cook, L., Eignor, D., Steinberg, J., Sawaki, Y., & Cline, F. (2009). Using factor analysis to investigate the impact of accommodations on the scores of students with disabilities on a reading comprehension assessment. Journal of Applied Testing Technology, 10(2), 1-33.
  • Dorans, N.J., & Lawrence, I.M. (1999). The role of unity of analysis in dimensionality assessment. Princeton, NJ: Educational Testing Service.
  • Flora, D., & Curran, P. (2004). An empirical evaluation of alternative methods of estimation for confi rmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466-491.
  • Hambleton, R.K., & Jones, R.W. (1993). An NCME instructional module on comparison of Classical Test Theory and Item Response Theory and their applications to test development. Educational Measurement: Issues and Practice, 12(3), 38-47.
  • Herber, H. (1978). Teaching reading in content areas (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.
  • Hoover, W.A., & Gough, P.B. (1990). The simple view of reading. Reading and Writing, 2(2), 127-160.
  • Hoyle, R.H., & Panter, A.T. (1995). Writing about structural equation models. In R.H. Hoyle (Ed.), Structural equational modeling: Concepts, issues, and applications (pp. 158-176). Thousand Oaks, CA: Sage Publications.
  • Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fi t indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55.
  • Mendonça, S. (2008). Provas de avaliação da compreensão leitora: Estudo de validação [Reading comprehension tests: Validation studies] (Unpublished master's thesis). University of Minho, Braga.
  • Muthén, B.O., Du Toit, S.H., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Technical report.
  • Muthén, B.O., & Muthén, L. (2010). Mplus Version 6.1 [Software]. Los Angeles, CA: Muthén&Muthén.
  • Ouellette, G. (2006). What's meaning got to do with it: The role of vocabulary in word reading and reading comprehension. Journal of Educational Psychology, 98(3), 554-566.
  • Ozuru, Y., Rowe, M., O'Reilly, T., & McNamara, D.S. (2008). Where's the diffi culty in standardized reading tests: The passage or the question? Behavior Research Methods, 40(4), 1001-1015.
  • RAND Reading Study Group (2002). Reading for understanding: Toward an R&D program in reading comprehension. Santa Monica, CA: RAND Corporation.
  • Shankweiler, D., Lundquist, E., Katz, L., Stuebing, K.K., Fletcher, J.M., Brady, S., Fowler, A., et al. (1999). Comprehension and decoding: Patterns of association in children with reading diffi culties. Scientifi c Studies of Reading, 3(1), 69-94.
  • Sim-Sim, I., & Viana, F.L. (2007). Para a avaliação do desempenho de leitura [To evaluate reading achievement]. Lisbon: Ministério da Educação-Gabinete de Estatística e Planeamento da Educação.
  • Swaby, B. (1989). Diagnosis and correction of reading diffi culties. Boston: Allyn and Bacon.
  • Yu, C.Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. Los Angeles: University of California.