Validity of a reading comprehension test for Portuguese students
- Cadime, Irene
- Ribeiro, Iolanda
- Viana, Fernanda Leopoldina P.
- Santos, Sandra
- Prieto Adánez, Gerardo
- Maia, José
ISSN: 0214-9915
Year of publication: 2013
Volume: 25
Issue: 3
Pages: 384-389
Type: Article
More publications in: Psicothema
Abstract
Background: The purpose of this work was to collect construct and criterion-related evidence of validity for a reading comprehension test (TCL - Teste de Compreensão da Leitura) with three vertically scaled forms, designed to assess students from second, third and fourth grade. Method: Two studies were conducted. In the first (n = 1,229), a confirmatory factor analysis was performed to analyse the test dimensionality. In the second (n= 402), concurrent and predictive evidence of validity was analysed using correlations between TCL, other reading tests and academic achievement. Results: Confirmatory factor analysis results supported a one-factor structure. Correlation coefficients with other reading tests were low to moderate and statistically significant. The TCL forms were shown to be good predictors of students� reading comprehension as assessed by teachers and of the National Exams of Portuguese Language results. Conclusions: Present results provide empirical evidence for the validity of the TCL forms.
Bibliographic References
- American Educational Research Association (AERA) (1999). Standards for educational and psychological testing. Washington, DC: AERA.
- Barrett, T. (1976). Taxonomy of reading comprehension. In R. Smith & T. Barrett (Eds.), Teaching reading in the middle class (pp. 51-58). Boston, MA: Addison-Wesley.
- Basaraba, D., Yovanoff, P., Alonzo, J., & Tindal, G. (2013). Examining the structure of reading comprehension: Do literal, inferential, and evaluative comprehension truly exist? Reading and Writing, 26(3), 349-379.
- Best, R.M., Floyd, R.G., & Mcnamara, D.S. (2008). Differential competencies contributing to children's comprehension of narrative and expository texts. Reading Psychology, 29(2), 137-164.
- Brown, T. (2006). Confi rmatory factor analysis for applied research. New York: The Guilford Press.
- Byrne, B. (2011). Structural equation modeling with Mplus: Basic concepts, applications and programming. New York: Routledge Academic.
- Català, G., Català, M., Molina, E., & Monclús, R. (2001). Evaluación de la comprensión lectora: Pruebas ACL [Assessment of reading comprehension: ACL tests]. Barcelona: Editorial Graó.
- Cook, L., Eignor, D., Steinberg, J., Sawaki, Y., & Cline, F. (2009). Using factor analysis to investigate the impact of accommodations on the scores of students with disabilities on a reading comprehension assessment. Journal of Applied Testing Technology, 10(2), 1-33.
- Dorans, N.J., & Lawrence, I.M. (1999). The role of unity of analysis in dimensionality assessment. Princeton, NJ: Educational Testing Service.
- Flora, D., & Curran, P. (2004). An empirical evaluation of alternative methods of estimation for confi rmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466-491.
- Hambleton, R.K., & Jones, R.W. (1993). An NCME instructional module on comparison of Classical Test Theory and Item Response Theory and their applications to test development. Educational Measurement: Issues and Practice, 12(3), 38-47.
- Herber, H. (1978). Teaching reading in content areas (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.
- Hoover, W.A., & Gough, P.B. (1990). The simple view of reading. Reading and Writing, 2(2), 127-160.
- Hoyle, R.H., & Panter, A.T. (1995). Writing about structural equation models. In R.H. Hoyle (Ed.), Structural equational modeling: Concepts, issues, and applications (pp. 158-176). Thousand Oaks, CA: Sage Publications.
- Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fi t indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55.
- Mendonça, S. (2008). Provas de avaliação da compreensão leitora: Estudo de validação [Reading comprehension tests: Validation studies] (Unpublished master's thesis). University of Minho, Braga.
- Muthén, B.O., Du Toit, S.H., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Technical report.
- Muthén, B.O., & Muthén, L. (2010). Mplus Version 6.1 [Software]. Los Angeles, CA: Muthén&Muthén.
- Ouellette, G. (2006). What's meaning got to do with it: The role of vocabulary in word reading and reading comprehension. Journal of Educational Psychology, 98(3), 554-566.
- Ozuru, Y., Rowe, M., O'Reilly, T., & McNamara, D.S. (2008). Where's the diffi culty in standardized reading tests: The passage or the question? Behavior Research Methods, 40(4), 1001-1015.
- RAND Reading Study Group (2002). Reading for understanding: Toward an R&D program in reading comprehension. Santa Monica, CA: RAND Corporation.
- Shankweiler, D., Lundquist, E., Katz, L., Stuebing, K.K., Fletcher, J.M., Brady, S., Fowler, A., et al. (1999). Comprehension and decoding: Patterns of association in children with reading diffi culties. Scientifi c Studies of Reading, 3(1), 69-94.
- Sim-Sim, I., & Viana, F.L. (2007). Para a avaliação do desempenho de leitura [To evaluate reading achievement]. Lisbon: Ministério da Educação-Gabinete de Estatística e Planeamento da Educação.
- Swaby, B. (1989). Diagnosis and correction of reading diffi culties. Boston: Allyn and Bacon.
- Yu, C.Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. Los Angeles: University of California.