Development of Listening Comprehension Tests with Narrative and Expository Texts for Portuguese Students

  1. Santos, Sandra
  2. Viana, Fernanda Leopoldina P.
  3. Ribeiro, Iolanda
  4. Prieto Adánez, Gerardo
  5. Brandao, Sara Luisa
  6. Cadime, Irene
Revista:
The Spanish Journal of Psychology

ISSN: 1138-7416

Año de publicación: 2015

Volumen: 18

Tipo: Artículo

DOI: 10.1017/SJP.2015.7 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: The Spanish Journal of Psychology

Resumen

This investigation aimed to develop and collect psychometric data for two tests assessing listening comprehension of Portuguese students in primary school: the Test of Listening Comprehension of Narrative Texts (TLC-n) and the Test of Listening Comprehension of Expository Texts (TLC-e). Two studies were conducted. The purpose of study 1 was to construct four test forms for each of the two tests to assess first, second, third and fourth grade students of the primary school. The TLC-n was administered to 1042 students, and the TLC-e was administered to 848 students. The purpose of study 2 was to test the psychometric properties of new items for the TLC-n form for fourth graders, given that the results in study 1 indicated a severe lack of difficult items. The participants were 260 fourth graders. The data were analysed using the Rasch model. Thirty items were selected for each test form. The results provided support for the model assumptions: Unidimensionality and local independence of the items. The reliability coefficients were higher than .70 for all test forms. The TLC-n and the TLC-e present good psychometric properties and represent an important contribution to the learning disabilities assessment field.

Referencias bibliográficas

  • American Educational Research Association (AERA) (1999). Standards for educational and psychological testing. Washington, DC: AERA.
  • Barrett T. C. (1976). Taxonomy of reading comprehension. In T. C. Barrett (Ed.), Teaching reading in the middle class (pp. 51–58). Boston, MA: Addison-Wesley.
  • Berninger V., & Abbott R. (2010). Listening comprehension, oral expression, reading comprehension and written expression: Related yet unique language systems in grades 1, 3, 5, and 7. Journal of Educational Psychology, 102, 635–651. http://dx.doi.org/10.1037/a0019319
  • Bond T. G., & Fox C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd Ed.). Mahwah, NJ: Lawrence Erlbaum.
  • Cain K., & Oakhill J. (2008). Cognitive bases of children’s language comprehension difficulties. Where do we go from here? In K. Cain & J. Oakhill (Eds.), Children’s comprehension problems in oral and written language. A cognitive perspective (pp. 283–295). New York, NY: The Guilford Press.
  • Català G., Català M., Molina E., & Monclús R. (2001). Evaluación de la comprensión lectora: Pruebas ACL (1o–6o de primaria) [Reading comprehension assessment: ACL Tests (from 1st to 6th grade)]. Barcelona, Spain: Editorial Graó.
  • De Ayala R. J. (2009). The theory and practice of item response theory. New York, NY: The Guilford Press.
  • Diakidoy I., Stylianou P., Karefillidou C., & Papageorgiou P. (2004). The relationship between listening and reading comprehension of different types of text at increasing grade levels. Reading Psychology, 26, 55–80. http://dx.doi. org/10.1080/02702710590910584
  • Dorans N. J., Moses T. P., & Eignor D. (2011). Equating test scores: Toward best practices. In A. A. von Davier (Ed.), Statistical models for test equating, scaling, and linking (pp. 21–42). New York, NY: Springer.
  • Graesser A., Golding J. M., & Long D. L. (1991). Narrative representation and comprehension. In R. Barr, M. L. Kamil, P. B. Mosenthal, & P. D. Pearson (Eds.), Handbook of Reading Research: Vol. 2 (pp. 171–205). New York, NY: Longman.
  • Graesser A. C., Singer M., & Trabasso T. (1994). Constructing inferences during narrative text comprehension. Psychological Review, 101, 371–395. http://dx.doi. org/10.1037/0033-295x.101.3.371
  • Harris T., & Hodges R. (Eds.) (1995). The literacy dictionary. Newark, DE: International Reading Association.
  • Herber H. (1978). Teaching reading in content areas (2nd Ed.). Englewood Cliffs, NJ: Prentice-Hall.
  • Hess K. (2007). Reading development and assessment of early literacy: A review of the literature. Utah, UT: Utah Department of Education.
  • Hoover W. A., & Gough P. B. (1990). The simple view of reading. Reading and Writing: An Interdisciplinary Journal, 2, 127–160. http://dx.doi.org/10.1007/BF00401799
  • Hulme C., & Snowling M. J. (2011). Children’s reading comprehension difficulties: Nature, causes, and treatments. Current Directions in Psychological Science, 20, 139–142. http://dx.doi.org/10.1177/0963721411408673
  • Huynh H., & Meyer P. (2010). Use of robust z in detecting unstable items in item response theory models. Practical Assessment, Research & Evaluation, 15, 1–8.
  • Johns J. L. (2008). Basic reading inventory: Pre-primer through grade twelve and early literacy assessments (10th Ed.). Dubuque, IA: Kendall/Hunt Publishing Company.
  • Kintsch W. (1998). Comprehension: A paradigm for cognition. New York, NY: Cambridge University Press.
  • Kolen M., & Brennan R. (2010). Test equating, scaling and linking (2nd Ed.). New York, NY: Springer.
  • Lee L. W. (2008). Development and validation of a readingrelated assessment battery in Malay for the purpose of dyslexia assessment. Annals of Dyslexia, 58, 37–57. http://dx.doi.org/10.1007/s11881-007-0011-0
  • Lehto J. E., & Anttila M. (2003). Listening comprehension in primary level grades two, four and six. Scandinavian Journal of Educational Research, 47, 133–143. http://dx.doi. org/10.1080/00313830308615
  • Leslie L., & Caldwell J. (2006). Qualitative reading inventory-4. New York, NY: Pearson Education.
  • Linacre J. M. (2002). What do infit and outfit, mean-square and standardized mean? Rasch Measurement Transactions, 16, 878.
  • Linacre J. M. (2011). A user’s guide to WINSTEPS and MINISTEP: Rasch-model computer programs. Program manual 3.72.0. Chicago, CA: Mesa Press.
  • Nation K. (2005). Children’s reading comprehension difficulties. In M. Snowling & C. Hulme (Eds.), The science of reading: A handbook (pp. 248–265). Oxford, UK: Blackwell Publishing Ltd.
  • Oakhill J. (1994). Individual differences in children’s text comprehension. In A. M. Gernsbacher (Ed.), Handbook of psycholinguistics (pp. 821–848). San Diego, CA: Academic.
  • Shanker J. L., & Cockrum W. (2009). Ekwall/Shanker reading inventory (5th Ed.). Boston, MA: Allyn & Bacon.
  • Snowling M. J., & Hulme C. (2005). The science of reading: A handbook. Oxford, UK: Blackwell Publishing Ltd.
  • Torgesen J. K. (2002). The prevention of reading difficulties. Journal of School Psychology, 40, 7–26. http://dx.doi.org/ 10.1016/S0022-4405(01)00092-9
  • Vellutino F. R., Tunmer W. E., Jaccard J. J., & Chen R. S. (2007). Components of reading ability: Multivariate evidence for a convergent skills model of reading development. Scientific Studies of Reading, 11, 3–32. http://dx.doi.org/10.1080/10888430709336632