본문 바로가기
KERD
논문KCI 등재

A Comparison of Readability and Understandability in Second Language Acquisition Textbooks for Pre-service EFL Teachers

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

초록

Teachers must be able to comprehend their textbooks in order to fully benefit from their preparation programs. However, it is yet unclear whether textbooks used to teach challenging content to pre-service non-native speaking English teachers might be beyond their ability. To investigate this question, a textbook readability analysis was performed with the Coh-Metrix text analysis tool. Textbook understandability was also assessed by means of maze passages given to teacher candidates in a pre-service English teacher education program. Readability analyses results indicated that the majority of the texts are excessively challenging for L2 readers at the level of the participants. Understandability findings revealed that many texts were able to be read independently but that all texts could be understood with scaffolding. Contrary to prior understandability research findings that showed that these textbooks were too difficult, this study found them to be suitable for their audience. However, a correlation between text understandability and course grades indicates that ability to comprehend the text could relate to course performance. Implications are that EFL teacher educators must recognize the importance of readability for textbook selection criteria and provide learners with access to other supplementary materials to scaffold their learning.

Abstract

Teachers must be able to comprehend their textbooks in order to fully benefit from their preparation programs. However, it is yet unclear whether textbooks used to teach challenging content to pre-service non-native speaking English teachers might be beyond their ability. To investigate this question, a textbook readability analysis was performed with the Coh-Metrix text analysis tool. Textbook understandability was also assessed by means of maze passages given to teacher candidates in a pre-service English teacher education program. Readability analyses results indicated that the majority of the texts are excessively challenging for L2 readers at the level of the participants. Understandability findings revealed that many texts were able to be read independently but that all texts could be understood with scaffolding. Contrary to prior understandability research findings that showed that these textbooks were too difficult, this study found them to be suitable for their audience. However, a correlation between text understandability and course grades indicates that ability to comprehend the text could relate to course performance. Implications are that EFL teacher educators must recognize the importance of readability for textbook selection criteria and provide learners with access to other supplementary materials to scaffold their learning.

참고문헌 (78)

  1. Adelberg, A. H., "The Cloze procedure: A methodology for determining the understandability of accounting textbooks", Accounting Review, 59(1), pp.109~122 (1984)
  2. Alderson, J. C., "Language test construction and evaluation" (1995), Cambridge University Press
  3. Armbruster, B. B., "Readability formulas may be dangerous to your textbooks", Educational Leadership, 42(7), pp.18~20 (1985)
  4. Bailin, A., "The linguistic assumptions underlying readability formulae : A critique", Language & Communication, 21(3), pp.285~301 (2001)
  5. Benjamin, R. G., "Reconstructing readability : Recent developments and recommendations in the analysis of text difficulty", Educational Psychology Review, 24(1), pp.63~88 (2012)
  6. Bensoussan, M., "Testing EFL reading comprehension using a multiple-choice rational cloze", The Modern Language Journal, 68(3), pp.230~239 (1984)
  7. Berti, A. E., "Capitalism and socialism : How 7th graders understand and misunderstand the information presented in their geography textbooks", European Journal of Psychology of Education, 6(4), pp.411~421 (1991)
  8. Blignaut, A. S., "Using readability, comprehensibility and lexical coverage to evaluate the suitability of an introductory accountancy textbook to its readership", Stellenbosch Papers in Linguistics, 46(1), pp.155~180 (2016)
  9. Brown, J. D., "An EFL readability index", JALT Journal, 15(2), pp.7~36 (1998)
  10. Brown, J. D., "Testing in language programs: A comprehensive guide to English language assessment" (2005), McGraw-Hill
  11. Chall, J. S., "Qualitative assessment of text difficulty: A practical guide for teachers and writers" (1996), Brookline Books
  12. Chavez-Oller, M. A., "When are cloze items sensitive to constraints across sentences?", Language Learning, 35(2), pp.181~206 (1985)
  13. Chavkin, L., "Readability and reading ease revisited: State-adopted science textbooks", The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 70(3), pp.151~154 (1997)
  14. Chen, A. C. -H., "A critical evaluation of text difficulty development in ELT textbook series: A corpus-based approach using variability neighbor clustering", System, 58, pp.64~81 (2016)
  15. Cline, T. A., "Readability of community college textbooks and the reading ability of the students who use them", Journal of Reading Behavior, 5(2), pp.110~118 (1972)
  16. Cohen, A. D., "Assessing language ability in the classroom" (1994), Heinle and Heinle
  17. "Coh-Metrix"[URL]
  18. Crossley, S. A., "Text readability and intuitive simplification : A comparison of readability formulas", Reading in a Foreign Language, 23(1), pp.86~101 (2011)
  19. Crossley, S. A., "Assessing text readability using cognitively based indices", TESOL Quarterly, 42(3), pp.475~493 (2008)
  20. Crossley, S. A., "Predicting text comprehension, processing, and familiarity in adult readers: New approaches to readability formulas", Discourse Processes, 54(5–6), pp.340~359 (2017)[DOI]
  21. Daniels, D., "A study of science textbook readability", Australian Science Teachers Journal, 42(3), pp.61~65 (1996)
  22. Davidson, R. A., "Analysis of the complexity of writing used in accounting textbooks over the past 100 years", Accounting Education, 14(1), pp.53~74 (2005)
  23. De Clercq, O., "Using the crowd for readability prediction", Natural Language Engineering, 20(3), pp.293~325 (2014)
  24. DuBay, W. H., "The principles of readability" (2004), Impact Information
  25. Fotos, S. S., "The cloze test as an integrative measure of EFL proficiency: A substitute for essays on college entrance examinations?", Language Learning, 41(3), pp.313~336 (1991)
  26. Fry, E. B., "Reading formulas : Maligned but valid", Journal of Reading, 32(4), pp.292~297 (1989)
  27. Fulcher, G., "Text difficulty and accessibility : Reading formulae and expert judgement", System, 25(4), pp.497~513 (1997)
  28. Gillingham, M. G., "Readers’ comprehension of mazes embedded in expository texts", The Journal of Educational Research, 85(4), pp.234~241 (1992)
  29. Goldin, I. M., "International conference on artificial intelligence in education (Vol. 7926)", pp.522~531 (2013), Springer
  30. Graesser, A. C., "Coh-Metrix : Providing multilevel analyses of text characteristics", Educational Researcher, 40(5), pp.223~234 (2011)
  31. Graesser, A. C., "Coh-Metrix : Analysis of text on cohesion and language", Behavior Research Methods, 36(2), pp.193~202 (2004)
  32. Gray, C. J., "Readability: A factor in student research?", The Reference Librarian, 53(2), pp.194~205 (2012)
  33. Greenfield, J., "Readability formulas for EFL", JALT Journal, 26(1), pp.5~24 (2004)
  34. Guthrie, J. T., "The maze technique to assess, monitor reading comprehension", The Reading Teacher, 28(2), pp.161~168 (1974)
  35. Confirmatory factor analysis of the Test of English as a Foreign Language, "Hale, G. A.", Educational Testing Service, ~, pp.TOEFL Research Report No. 32 (1989)
  36. The relation of multiple-choice cloze items to the Test of English as a Foreign Language, "Hale, G. A.", Educational Testing Service, ~, pp.TOEFL Research Report No. 26 (1988)
  37. Hurley, S. R., "Literacy assessment of second language learners" (2001), Allyn & Bacon
  38. Ives Wiley, H., "Oral reading and maze measures as predictors of success for English learners on a state standards assessment", Remedial and Special Education, 26(4), pp.207~214 (2005)
  39. Johns, A. M., "Text, role and context: Developing academic literacies" (1997), Cambridge University Press
  40. Johnson, E. S., "The technical properties of science content maze passages for middle school students", Assessment for Effective Intervention, 38(4), pp.214~223 (2013)
  41. Jones, M. J., "Methodological themes: Critical appraisal of the Cloze procedure’s use in the accounting domain", Accounting, Auditing & Accountability Journal, 10(1), pp.105~128 (1997)
  42. Kasule, D., "Textbook readability and ESL learners", Reading & Writing-Journal of the Reading Association of South Africa, 2(1), pp.63~76 (2011)
  43. Kim, J. S., "Predictive validity of curriculum-based measures for English learners at varying English proficiency levels", Educational Assessment, 21(1), pp.1~18 (2016)
  44. Kumazawa, T., "Factors affecting multiple-choice cloze test score variance : A perspective from generalizability theory", International Journal of Language Studies, 10(1), pp.15~30 (2016)
  45. Markham, P. L., "Rational deletion cloze processing strategies : ESL and native English", System, 15(3), pp.303~311 (1987)
  46. McKamey, T., "Getting closure on cloze: A validation study of the "rational deletion" method", Second Langauge Studies Paper, 24(2), pp.114~164 (2006)
  47. McNamara, D. S., "Automated evaluation of text and discourse with Coh-Metrix" (2014), Cambridge University Press
  48. Mohebbi, H., "Readability of ESP textbooks in Iran: A neglected issue or a taken-for-granted one?", Journal of Teaching English for Specific and Academic Purposes, 4(3), pp.641~654 (2017)
  49. Moussu, L., "Non-native English-speaking English language teachers: History and research", Language Teaching, 41(3), pp.315~348 (2008)
  50. Oakland, T., "Language, reading, and readability formulas: Implications for developing and adapting tests", International Journal of Testing, 4(3), pp.239~252 (2004)
  51. Oller, J. W., "Cloze and coherence" (1994), Bucknell University Press
  52. Oppenheimer, D. M., "Instructional manipulation checks: Detecting satisficing to increase statistical power", Journal of Experimental Social Psychology, 45(4), pp.867~872 (2009)
  53. Parker, R., "The maze as a classroom-based reading measure : Construction methods, reliability, and validity", The Journal of Special Education, 26(2), pp.195~218 (1992)
  54. Plucinski, K. J., "Readability of introductory financial and managerial accounting textbooks", Academy of Educational Leadership Journal, 13(4), pp.119~127 (2009)
  55. Razek, J. R., "Readability of accounting textbooks", The Journal of Business Education, 58(1), pp.23~26 (1982)
  56. Reed, D. K., "An examination of text complexity as characterized by readability and cohesion", The Journal of Experimental Education, 84(1), pp.75~97 (2016)
  57. Robison, T., "Readability levels show that social studies textbooks are written above grade level reading", Journal of Teacher Action Research, 1(2), pp.100~111 (2015)
  58. Sadeghi, K., "Cloze validation against IELTS reading paper: Doubts on correlational validation", Journal of English Language Teaching and Learning, 217(2), pp.131~154 (2010)
  59. Saeedi, M., "Construct validity of multiple-choice cloze test and cloze-elide test in testing reading comprehension among Iranian EFL learners", International Research Journal of Applied and Basic Sciences, 10(6), pp.632~637 (2016)
  60. Saito, Y., "Investigating the construct validity of the cloze section in the examination for the certificate of proficiency in English", Spaan Fellow Working Papers in Second or Foreign Language Assessment, 1, pp.39~82 (2003)
  61. Sattarpour, S., "Investigating the relatedness of cloze-elide test, multiple-choice cloze test, and C-test as measures of reading comprehension", Journal of English Language Teaching and Learning, 6(13), pp.89~112 (2014)
  62. Schneider, D. E., "Assessing the readability of college textbooks in public speaking : Attending to entry level instruction", Communication Teacher, 25(4), pp.246~255 (2011)
  63. Shanahan, T., "Cloze as a measure of intersentential comprehension", Reading Research Quarterly, 17, pp.229~255 (1982)
  64. Smith, K. J., "The selection process for accounting textbooks: General criteria and publisher incentives–a survey", Issues in Accounting Education, 12(2), pp.367~384 (1997)
  65. Smith, M., "Readability and understandability: Different measures of the textual complexity of accounting narrative", Accounting, Auditing & Accountability Journal, 5(4), pp.84~98 (1992)
  66. Snyman, M., "Using the printed medium to disseminate information about psychiatric disorders", African Journal of Psychiatry, 7(4), pp.15~20 (2004)
  67. Spinks, N., "Readability: A textbook selection criterion", Journal of Education for Business, 69(2), pp.83~87 (1993)
  68. Tabatabaei, O., "Correlational validation of cloze test and c-test against IELT", Journal of Educational and Social Research, 4(1), pp.345~356 (2014)
  69. Tanaka-Ishii, K., "Sorting texts by readability", Computational Linguistics, 36(2), pp.203~227 (2010)
  70. Tichá, R., "Reading progress monitoring for secondary-school students : Reliability, validity, and sensitivity to growth of reading-aloud and maze-selection measures", Learning Disabilities Research & Practice, 24(3), pp.132~142 (2009)
  71. Tinkler, S., "The readability of principles of macroeconomics textbooks", The Journal of Economic Education, 44(2), pp.178~191 (2013)
  72. Tolar, T. D., "Psychometric properties of maze tasks in middle school students", Assessment for Effective Intervention, 37(3), pp.131~146 (2012)
  73. Umoke, C. C., "Examination of the readability level of some approved science textbooks in use in junior secondary schools in Ebinyi state of Nigeria", British Journal of Education, 3(11), pp.26~31 (2015)
  74. Wait, S. S., "Textbook readability and the predictive value of the Dale-Chall, comprehensive assessment program, and cloze", doctor, pp.1987
  75. Williams, R. S., "Measuring college students’ reading comprehension ability using cloze tests", Journal of Research in Reading, 34(2), pp.215~231 (2011)
  76. "Test of reading comprehension maze passage generator" (2013)[URL]
  77. Yamashita, J., "Processes of taking a gap-filling test: Comparison of skilled and less skilled EFL readers", Language Testing, 20(3), pp.267~293 (2003)
  78. Zamanian, M., "Readability of texts: State of the art", Theory and Practice in Language Studies, 2(1), pp.43~53 (2012)

관련 논문AI추천

이 간행물의 다른 논문 (25건)