Evaluating SLA Textbook Comprehensibility: Comparing Coh-Metrix Results With EFL Teachers' Ratings
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Target language textbooks are widely used in English teacher preparation programs, but the decision to use them is commonly made with minimal consideration of their difficulty level for the teacher candidates. The purpose of this study was to assess their readability for bilingual pre-service teachers. To accomplish this task, the Coh-Metrix linguistic analysis software was used to analyze the readability and easability of five widely-used SLA textbooks. Coh-Metrix readability indicators showed many of the texts to be at the post-secondary level for L1 speakers. Easability results revealed that texts often lacked many of the features that would make them easier to comprehend. Human readability ratings suggested that many pre-service teachers found them to be moderately challenging revealing somewhat of a mismatch with Coh-Metrix results. EFL teacher educator should consider readability when selecting textbooks for teacher education programs as they may need to provide teacher candidates with access to materials to scaffold their comprehension of these textbooks.
Abstract
Target language textbooks are widely used in English teacher preparation programs, but the decision to use them is commonly made with minimal consideration of their difficulty level for the teacher candidates. The purpose of this study was to assess their readability for bilingual pre-service teachers. To accomplish this task, the Coh-Metrix linguistic analysis software was used to analyze the readability and easability of five widely-used SLA textbooks. Coh-Metrix readability indicators showed many of the texts to be at the post-secondary level for L1 speakers. Easability results revealed that texts often lacked many of the features that would make them easier to comprehend. Human readability ratings suggested that many pre-service teachers found them to be moderately challenging revealing somewhat of a mismatch with Coh-Metrix results. EFL teacher educator should consider readability when selecting textbooks for teacher education programs as they may need to provide teacher candidates with access to materials to scaffold their comprehension of these textbooks.
참고문헌 (56)
- Adelberg, A. H., "The cloze procedure : A methodology for determining the understandability of accounting textbooks", Accounting Review, 59(1), pp.109~122 (1984)
- Armbruster, B. B., "Readability formulas may be dangerous to your textbooks", Educational Leadership, 42(7), pp.18~20 (1985)
- Blignaut, A. S., "Using readability, comprehensibility and lexical coverage to evaluate the suitability of an introductory accountancy textbook to its readership", Stellenbosch Papers in Linguistics, 46(1), pp.155~180 (2016)
- Brown, J. D., "An EFL readability index", JALT Journal, 15(2), pp.7~36 (1998)
- Carrell, P. L., "Readability in ESL", Reading in a Foreign Language, 4(1), pp.21~40 (1987)
- Chavkin, L., "Readability and reading ease revisited:State-adopted science textbooks", The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 70(3), pp.151~154 (1997)
- 최성희, "Developing the Korean EFL Readability Formula (KRF)", 영어어문교육, 18(3), pp.1~24 (2012), 한국영어어문교육학회
- 최윤정, "Effects of modified and non-modified text on EFL learners’ reading comprehension", 응용언어학, 26(4), pp.21~47 (2010), 한국응용언어학회
- Crossley, S. A., "Text readability and intuitive simplification : A comparison of readability formulas", Reading in a Foreign Language, 23(1), pp.84~101 (2011)
- Daniels, D., "A study of science textbook readability", Australian Science Teachers Journal, 42(3), pp.61~65 (1996)
- Davidson, R. A., "Analysis of the complexity of writing used in accounting textbooks over the past 100 years", Accounting Education, 14(1), pp.53~74 (2005)
- Drury, A., "Evaluating readability", IEEE Transactions on Professional Communication, 28(4), pp.11~14 (1985)
- DuBay, W. H., "The principles of readability" (2004), Impact Information
- Efklides, A., "Individual differences in feelings of difficulty : The case of school mathematics", European Journal of Psychology of Education, 13(2), pp.207~226 (1998)
- Ferris, D., "Feedback in second language writing:Contexts and issues", pp.81~104 (2006), Cambridge University Press
- Finn, S., "Unpredictability as correlate of reader enjoyment of news articles", Journalism Quarterly, 62(2), pp.334~345 (1985)
- Fulcher, G., "Text difficulty and accessibility : Reading formulae and expert judgement", System, 25(4), pp.497~513 (1997)
- Graesser, A. C., "Coh-Metrix : Providing multilevel analyses of text characteristics", Educational Researcher, 40(5), pp.223~234 (2011)
- Gray, C. J., "Readability: A factor in student research?", The Reference Librarian, 53(2), pp.194~205 (2012)
- Greenfield, J., "Readability formulas for EFL", JALT Journal, 26(1), pp.5~24 (2004)
- Heydari, P., "Readability of texts : Human evaluation versus computer index", Mediterranean Journal of Social Sciences, 3(1), pp.177~190 (2012)
- "The dangers of self-report" (2012)[URL]
- Jackson, G. T., "Adaptive educational technologies for literacy instruction", pp.49~68 (2016), Taylor & Francis
- Johns, A. M., "Text, role and context: Developing academic literacies" (1997), Cambridge University Press
- Jones, M. J., "Methodological themes: Critical appraisal of the Cloze procedure’s use in the accounting domain", Accounting, Auditing & Accountability Journal, 10(1), pp.105~128 (1997)
- Kanungo, T., "Predicting the readability of short web summaries", Proceedings of the Second ACM International Conference on Web Search and Data Mining, pp.202~211 (2009), ACM
- Kasule, D., "Textbook readability and ESL learners", Reading & Writing–Journal of the Reading Association of South Africa, 2(1), pp.63~76 (2011)
- 김영수, "Text Readability of the College Scholastic Ability Test and High School English II Textbooks", 영어교육, 67(4), pp.195~218 (2012), 한국영어교육학회[DOI]
- Kintsch, W., "Comprehension: A paradigm for cognition" (1998), Cambridge University Press
- McNamara, D. S., "Applied natural language processing: Identification, investigation and resolution", pp.188~205 (2012), IGI Global
- McNamara, D. S., "Coh-Metrix easability components:Aligning text difficulty with theories of text comprehension", Presented at the American Educational Research Association Conference (2011)
- McNamara, D. S., "Coh-Metrix: Capturing linguistic features of cohesion", Discourse Processes, 47(4), pp.292~330 (2010)
- McNamara, D. S., "Toward a comprehensive model of comprehension", Psychology of Learning and Motivation, 51, pp.297~384 (2009)
- Mohebbi, H., "Readability of ESP textbooks in Iran: A neglected issue or a taken-for-granted one?", Journal of Teaching English for Specific and Academic Purposes, 4(3), pp.641~654 (2017)
- Nuttall, C., "Teaching reading skills in a foreign language" (2005), Macmillan Education
- Oppenheimer, D. M., "Instructional manipulation checks : Detecting satisficing to increase statistical power", Journal of Experimental Social Psychology, 45(4), pp.867~872 (2009)
- Perfetti, C., "Reading ability : Lexical quality to comprehension", Scientific Studies of Reading, 11(4), pp.357~383 (2007)
- Pitler, E., "Revisiting readability:A unified framework for predicting text quality", Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp.186~195 (2008), Association for Computational Linguistics
- Plucinski, K. J., "Readability of introductory financial and managerial accounting textbooks", Academy of Educational Leadership Journal, 13(4), pp.119~127 (2009)
- Prince, S. A., "A comparison of direct versus self-report measures for assessing physical activity in adults : A systematic review", The International Journal of Behavioral Nutrition and Physical Activity, 5(1), pp.56~ (2008)
- Razavi, T., "Self-report measures: An overview of concerns and limitations of questionnaire use in occupational stress research", Discussion Papers in Accounting and Management Science (2001), University of Southampton
- Razek, J. R., "Readability of accounting textbooks", The Journal of Business Education, 58(1), pp.23~26 (1982)
- Reed, D. K., "An examination of text complexity as characterized by readability and cohesion", The Journal of Experimental Education, 84(1), pp.75~97 (2016)
- Rello, L., "Size matters (spacing not): 18 points for a dyslexic-friendly Wikipedia", Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility, pp.17~24 (2013), ACM
- Robison, T., "Readability levels show that social studies textbooks are written above grade level reading", Journal of Teacher Action Research, 1(2), pp.100~111 (2015)
- Schank, R. C., "Knowledge and memory: The real story", pp.1~85 (1995), Lawrence Erlbaum Associates
- Schneider, D. E., "Assessing the readability of college textbooks in public speaking : Attending to entry level instruction", Communication Teacher, 25(4), pp.246~255 (2011)
- Smith, M., "Readability and understandability:Different measures of the textual complexity of accounting narrative", Auditing & Accountability Journal, 5(4), pp.84~98 (1992)
- Snyman, M., "Using the printed medium to disseminate information about psychiatric disorders: Original article", African Journal of Psychiatry, 7(4), pp.15~20 (2004)
- Spinks, N., "Readability : A textbook selection criterion", Journal of Education for Business, 69(2), pp.83~87 (1993)
- Tinkler, S., "The readability of principles of macroeconomics textbooks", The Journal of Economic Education, 44(2), pp.178~191 (2013)
- Umoke, C. C., "Examination of the readability level of some approved science textbooks in use in junior secondary schools in Ebinyi state of Nigeria", British Journal of Education, 3(11), pp.26~31 (2015)
- Williamson, G. L., "A text readability continuum for postsecondary readiness", Journal of Advanced Academics, 19(4), pp.602~632 (2008)
- Wray, D., "Readability revisited? The implications of text complexity", The Curriculum Journal, 24(4), pp.553~562 (2013)
- Yan, X., "Concept-based document readability in domain specific information retrieval", Proceedings of the 15th ACM International Conference on Information and Knowledge Management, pp.540~549 (2006), ACM
- Zamanian, M., "Readability of texts:State of the art", Theory and Practice in Language Studies, 2(1), pp.43~53 (2012)
