본문 바로가기
KERD
논문KCI 등재

통역 교육에서의 원문 텍스트 난이도 평가 자동화: 코메트릭스(Coh-Metrix)를 이용한 다차원적 텍스트 난이도 평가를 중심으로

Automated assessment of source text difficulty in interpreter training: The use of Coh-Metrix for multidimensional text difficulty analysis

최문선
한국통역번역학회 (Korean Society of Interpretation and Translation Studies)|2023.04|통역과 번역 (Interpretation and Translation)|제25권 제1호|pp. 131-153|DOI https://doi.org/10.20305/it202301131153

1

조회

0

다운로드

1

인용

0

참고문헌

키워드

Coh-Metrixtext difficultysource textinterpreter trainingautomated text analysis
주제분류통역번역학

초록

While text difficulty is one of the critical considerations in developing and selecting materials for interpreter training, its assessment is a challenging task due to the complexities involved in analyzing a large number of text characteristics. The recent developments in automated text analysis methods and tools are expected to alleviate the burden of individual teachers and students assessing source text difficulty by aiding their decision making process with the immediate provision of data on the objective and quantifiable text dimensions. This study presents three cases of applying automated assessment of source text difficulty based on the five Text Easability Principal Component Scores provided by Coh-Metrix, a widely-used automated tool for multilevel analyses of text characteristics. For the purpose of the study, source texts used for interpreter training in Korea and China were sampled to conduct text difficulty assessment with Coh-Metrix measures and its visualization tool. The study discusses the potential benefits of automated analysis of multidimensional text difficulty for selecting the appropriate materials for effective interpreter training.

Abstract

While text difficulty is one of the critical considerations in developing and selecting materials for interpreter training, its assessment is a challenging task due to the complexities involved in analyzing a large number of text characteristics. The recent developments in automated text analysis methods and tools are expected to alleviate the burden of individual teachers and students assessing source text difficulty by aiding their decision making process with the immediate provision of data on the objective and quantifiable text dimensions. This study presents three cases of applying automated assessment of source text difficulty based on the five Text Easability Principal Component Scores provided by Coh-Metrix, a widely-used automated tool for multilevel analyses of text characteristics. For the purpose of the study, source texts used for interpreter training in Korea and China were sampled to conduct text difficulty assessment with Coh-Metrix measures and its visualization tool. The study discusses the potential benefits of automated analysis of multidimensional text difficulty for selecting the appropriate materials for effective interpreter training.

참고문헌 (32)

  1. 고나은, "Coh-Metrix를 이용한 수능 영어 읽기 영역 지문 난이도 비교: EBS-수능 연계 정책 전후", 중등영어교육, 10(4), pp.3~24 (2017), 한국중등영어교육학회
  2. 안병길, "코메트릭스(Coh-Metrix)를 이용한 한국과 미국의 RNR 코퍼스의 언어학적 비교 분석", 현대영미어문학, 40(1), pp.113~142 (2022), 현대영미어문학회
  3. 이주윤, "절대평가 실시 이후 수능 영어 영역 문항 유형별 언어적 특성 및 난이도 비교", 영어평가, 17(1), pp.45~63 (2022), 한국영어평가학회[DOI]
  4. 이현지, "Coh-Metrix를 활용한 한국과 핀란드의 대학입학시험읽기 지문 난이도 비교 연구", 영어교과교육, 21(3), pp.183~203 (2022), 한국영어교과교육학회
  5. 이혜진, "한･중･일 대학 입학시험 영어 지문의 이독성 비교 분석", 인문사회 21, 9(5), pp.441~454 (2018), 인문사회 21[DOI]
  6. 박정곤, "Coh-Metrix를 활용한 고등학교 영어 교과서와 대학수학능력시험 읽기 지문 난이도 비교 연구", 영어영문학연구, 47(3), pp.147~170 (2021), 대한영어영문학회[DOI]
  7. 최문선, "영한 순차통역 교육을 위한 원천텍스트 난이도 연구 : 텍스트적 요인을 중심으로", 박사, 통역번역학과, pp.2013
  8. Alexieva, B., "Understanding the source language text in simultaneous interpreting", The Interpreters' Newsletter, 9, pp.45~59 (1999)
  9. Andres, D., "To Know How to Suggest : Approaches to Teaching Conference Interpreting", pp.103~124 (2015), Frank & Timme
  10. 최문선, "Assessing Source Text Difficulty in Interpreter Education: Expert Assessment and the Measurement of Textual Properties", 통번역교육연구, 11(2), pp.25~47 (2013), 한국통번역교육학회
  11. Dowell, N. M., "Language and discourse analysis with Coh-Metrix : Applications from educational material to learning environments at scale", Journal of Learning Analytics, 3(3), pp.72~95 (2016)
  12. Dillinger, M., "Bridging the Gap: Empirical Studies in Simultaneous Interpretation", pp.155~189 (1994), John Benjamins
  13. Gile, D., "Basic Concepts and Models for Interpreter and Translator Training" (2009), John Benjamins
  14. Graesser, A. C., "Computational analyses of multilevel discourse comprehension", Topics in Cognitive Science, 3(2), pp.371~398 (2011)
  15. Graesser, A. C., "Coh-Metrix measures text characteristics at multiple levels of language and discourse", The Elementary School Journal, 115(2), pp.210~229 (2014)
  16. Graesser, A. C., "Coh-Metrix : Providing multilevel analyses of text characteristics", Educational Researcher, 40(5), pp.223~234 (2011)
  17. Hild, A., "Methods and Strategies of Process Research: Integrative Approaches in Translation Studies", pp.249~267 (2011), John Benjamins
  18. Hönig, H. G., "Piece of cake - or hard to take? Objective grades of difficulty of speeches used in interpreting training", Proceedings from the EMCI Workshop on Teaching Simultaneous Interpretation Into a "B" Language, pp.38~50 (2002)
  19. Jiang, X., "Effect of dependency distance of source text on disfluencies in interpreting", Lingua, 243, pp.1~8 (2020)
  20. Kraviarová, Z., "Assessing source speech difficulty for research purposes", Forum, 11(1), pp.51~75 (2013)
  21. Liu, M., "Assessing source material difficulty for consecutive interpreting : Quantifiable measures and holistic judgment", Interpreting, 11(2), pp.244~266 (2009)
  22. Liu, M., "Working memory and expertise", Interpreting, 6(1), pp.19~42 (2004)
  23. McNamara, D. S., "Coh-Metrix Easability Components: Aligning Text Difficulty with Theories of Text Comprehension", Paper presented at the Annual Meeting of the American Educational Research Association(AERA 2011) (2011)
  24. McNamara, D. S., "Automated Evaluation of Text and Discourse with Coh-Metrix" (2014), Cambridge University Press
  25. Pöchhacker, F., "Introducing Interpreting Studies" (2004), Routledge
  26. Seleskovitch, D., "Silver Spring: The Registry of Interpreters for the Deaf", Silver Spring: The Registry of Interpreters for the Deaf, ~ (1995)
  27. Setton, R, "Simultaneous Interpretation : A Cognitive-pragmatic Analysis" (1999), John Benjamins
  28. Setton, R., "Knowledge Systems and Translation", pp.275~312 (2005), M. de Gruyter
  29. Setton, R., "Conference Interpreting : A Trainer's Guide" (2016), John Benjamins
  30. Tommola, J., "Unity in Diversity? Current Trends in Translation Studies", pp.177~186 (1998), St. Jerome Publishing
  31. Yuan, R., "Material development for beginner student interpreters: How does text structure contribute to the difficulty of consecutive interpreting?", The Interpreter and Translator Trainer, 16(1), pp.58~77 (2022)
  32. Wang, J., "New English–Chinese Interpreting Course" (2011), Renmin University of China Press

관련 논문AI추천

Assessing Source Text Difficulty in Interpreter Education: Expert Assessment and the Measurement of Textual Properties최문선한국통번역교육학회 · 통번역교육연구2013 · 제11권 제2호통역 학습자의 원천텍스트 난이도 평가최문선한국번역학회 · 번역학연구2015 · 제16권 제5호통역 교육에서의 난이도와 난이도 요인 — 통역 교육 전문가 조사를 중심으로최문선한국번역학회 · 번역학연구2012 · 제13권 제5호Interpreter Training Materials from Korea and China: Corpus-based Comparison of English Source Texts최문선통번역연구소 · 통번역학연구2023 · 제27권 제1호통역 교육에서 출발텍스트 선정과난이도 고려에 대한 소고최문선한국통역번역학회 · 통역과 번역2013 · 제15권 제2호번역교육을 위한 텍스트 난이도 평가 기준에 대한 소고이미경한국번역학회 · 번역학연구2012 · 제13권 제2호

이 간행물의 다른 논문 (7건)

소셜미디어 상에서의 통역사에 대한 인식과 통역 콘텐츠 분석: 유튜브(Youtube)의 비정형 데이터를 이용한 텍스트 마이닝 분석과 질적 사례연구권상미pp. 1-26통번역대학원 한영번역 수업에서의 플립러닝 적용사례이상애pp. 27-47기계번역 사용, 기계번역 교육, 번역가 진로에 관한 인식 조사: 학부번역전공자를 대상으로 한 소규모 설문조사를 기반으로이선우, 이상빈pp. 49-73A case study on the evaluation of Korean-English legal translations by generic and custom neural machine translation engines이지은, 최효은pp. 75-98중한 번역 그림책에서 멀티모달리티를 구현한 트랜스크리에이션 전략 고찰이지혜pp. 99-130
원문 보기