Assessing Source Text Difficulty in Interpreter Education: Expert Assessment and the Measurement of Textual Properties
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Since STs in interpreter education are commonly selected by teachers, instructors must also determine the right level of the difficulty of STs for classwork and exams in order to ensure the appropriateness of the materials. However, interpreting teachers tend to disagree on the optimal level of difficulty of a given ST, resulting in less reliable assessment results. This study, therefore, addressed two questions related to the subjective determination of ST difficulty by interpreting teachers: 1) how consistent are their assessments with one another?; and 2) what are the textual properties related to their subjective judgments of ST difficulty? 15 interpreting teachers from postgraduate English-Korean interpreting programs rated the difficulty of five English STs and the scores they assigned were compared. Very low inter-rater consistency is found in the subjective judgment of ST difficulty. On the other hand, the participants' difficulty assessment of the STs, on the basis of the mean values of their scores, showed significant correlations with the average length of T-unit, Flesch Reading Ease Score and type-to-token ratio of the STs. Thus, subjective evaluating of vocabulary- and sentence-related difficulty should be replaced by these quantifiable indicators.
Abstract
Since STs in interpreter education are commonly selected by teachers, instructors must also determine the right level of the difficulty of STs for classwork and exams in order to ensure the appropriateness of the materials. However, interpreting teachers tend to disagree on the optimal level of difficulty of a given ST, resulting in less reliable assessment results. This study, therefore, addressed two questions related to the subjective determination of ST difficulty by interpreting teachers: 1) how consistent are their assessments with one another?; and 2) what are the textual properties related to their subjective judgments of ST difficulty? 15 interpreting teachers from postgraduate English-Korean interpreting programs rated the difficulty of five English STs and the scores they assigned were compared. Very low inter-rater consistency is found in the subjective judgment of ST difficulty. On the other hand, the participants' difficulty assessment of the STs, on the basis of the mean values of their scores, showed significant correlations with the average length of T-unit, Flesch Reading Ease Score and type-to-token ratio of the STs. Thus, subjective evaluating of vocabulary- and sentence-related difficulty should be replaced by these quantifiable indicators.
참고문헌 (34)
- Alexieva, B., "The optimum text in simultaneous interpreting: A cognitive approach to interpreter training, In Teaching Translation and Interpreting", pp.221~230 (1992), John Benjamins Publishing
- Alexieva, B., "Understanding the source language text in simultaneous interpreting", The Interpreters' Newsletter, 9, pp.45~59 (1999)
- Anderson, A., "Listening" (1988), Oxford University Press
- Bachman, L. F., "Language Testing in Practice: Designing and Developing Useful Language Tests" (1996), Oxford University Press
- Brown, C., "Automatic measurement of propositional idea density from part-of-speech tagging", Behavior Research Methods, 40(2), pp.540~545 (2008)
- Buch, G., "Assessing Listening" (2001), Cambridge University Press
- Chall, J. S., "Qualitative Assessment of Text Difficulty: A Practical Guide for Teachers and Writers" (1996), Brookline Books
- Chernov, G. V., "Inference and Anticipation in Simultaneous Interpreting : A Probability-Prediction Model" (2004), John Benjamins
- Choi, Moonsun, "Assessing Source Text Difficulty for Interpreter Education: With a Focus on Textual Factors of English Source Texts in English-Korean Consecutive Interpreting", 박사, pp.2013
- Dillinger, M., "Comprehension during interpreting: What do interpreters know that bilinguals don't?, In Bridging the Gap: Empirical Studies in Simultaneous Interpretation", pp.155~189 (1994), John Benjamins
- DuBay, W. H., "The Principles of Readability" (2004), Impact Information
- Flesch, R., "A new readability yardstick", Journal of Applied Psychology, 32(3), pp.221~233 (1948)
- Fulcher, G., "Text difficulty and accessibility : Reading formulae and expert judgment", System, 25, pp.497~513 (1997)
- Gaies, S. J., "T-unit analysis in second language research : Applications, problems and limitations", TESOL Quarterly, 14(1), pp.53~60 (1980)
- Green, A, "Empiricism versus connoisseurship : Establishing the appropriacy of texts in tests of academic reading", Language Testing, 27(2), pp.191~211 (2010)
- Hale, S., "The interaction between text difficulty and translation accuracy", Babel, 48(1), pp.14~33 (2002)
- Hild, A., "Effects of linguistic complexity on expert processing during simultaneous interpreting, In Methods and Strategies of Process Research: Integrative Approaches in Translation Studies", pp.249~267 (2011), John Benjamins
- Hönig, H. G., ". Piece of cake-or hard to take? Objective grades of difficulty of speeches used in interpreting training", Proceedings from the EMCI Workshop on Teaching Simultaneous Interpretation Into a "B" Language, pp.38~50 (2002)
- Just, M. A., "A theory of reading : from eye fixations to comprehension", Psychology Review, 87(4), pp.329~354 (1980)
- Kang, S., "Korean Language Assessment" (2006), Taehaksa
- Kintsch, W., "The Role of Knowledge in Discourse Comprehension : A Construction-Integration Model", Psychological Review, 95(2), pp.163~182 (1998)
- Kintsch, W., "Toward a model of text comprehension and production", Psychological Review, 85(5), pp.363~394 (1978)
- Kraviarová, Z., "Assessing source speech difficulty for research purposes", Forum, 11(1), pp.51~75 (2013)
- 이미경, "번역교육을 위한 텍스트 난이도 평가 기준에 대한 소고", 번역학연구, 13(2), pp.139~164 (2012), 한국번역학회[DOI]
- Liu, M., "Assessing source material difficulty for consecutive interpreting : Quantifiable measures and holistic judgment", Interpreting, 11(2), pp.244~266 (2009)
- Liu, M., "Working memory and expertise in simultaneous interpreting", Interpreting, 6(1), pp.19~42 (2004)
- Nord, C., "Text Analysis in Translation: Theory, Methodology, and Didactic Application of a Model for Translation-Oriented Text Analysis, In Translated from the German by Christiane Nord and Penelope Sparrow" (2005), Rodopi B. V
- Park, Hyekyung., "Rethinking interpreter training methodologies of Korean schools focusing on consecutive interpretation training for the first semester", Conference Interpretation and Translation, 8(2), pp.61~80 (2006)
- Sawyer, D. B., "Fundamental Aspects of Interpreter Education : Curriculum and Assessment" (2004), John Benjamins Publishing
- Seleskovitch, D., "A Systematic Approach to Teaching Interpretation, In The Registry of Interpreters for the Deaf" (1995)
- Setton, R., "Pointing to contexts: a relevance-theoretic approach to assessing quality and difficulty in interpreting, In Knowledge Systems and Translation", pp.275~312 (2005), M. de Gruyter
- Tommola, J., "Language direction and source text complexity: Effects on trainee performance in simultaneous interpreting, In Unity in Diversity? Current Trends in Translation Studies", pp.177~186 (1998), St. Jerome Publishing
- Yun, Changuk., "A Study on the Development of a Readability Formula in Non-literary Texts", 석사, pp.2006