본문 바로가기
KERD
논문KCI 등재

심리 화면해설의 객관성과 발화 운율이 등장인물의 감정 이해에 미치는 영향

Influences of Objectivity and Prosody in Audio Description on the Comprehension of Character Emotions

0

조회

0

다운로드

1

인용

0

참고문헌

키워드

주제분류통역번역학

초록

This study presents results from two speech perception experiments to provide empirical evidence for improving perceptual clarity in audio descriptions (AD) for character emotions. In both experiments, 27 participants with normal vision heard AD-style utterances that varied in objectivity of appraisals (i.e., words denoting emotion vs. words describing behavior) and in prosodic saliency of the appraisals, and then self-rated the degree of perceived emotions on a 9-point scale. As an effect of objectivity, subjective descriptions induced significantly higher emotion ratings than objective ones in Experiment 1, in which prior context was given minimally. In Experiment 2 which provided more faithful contextual information, however, perceived character emotion tended to be greater for objective appraisals, possibly suggesting that objective descriptions along with abundant context help the listeners actively reconstruct mental representations for the intended psychological states. The effects of prosody were more robust across the experiments. The ratings significantly increased when provided with more salient acoustic cues for the phrase boundary and prominence, highlighting the role of prosodically-driven articulatory strengthening in speech perception, which may be provided as a guideline for trained dubbing artists.

Abstract

This study presents results from two speech perception experiments to provide empirical evidence for improving perceptual clarity in audio descriptions (AD) for character emotions. In both experiments, 27 participants with normal vision heard AD-style utterances that varied in objectivity of appraisals (i.e., words denoting emotion vs. words describing behavior) and in prosodic saliency of the appraisals, and then self-rated the degree of perceived emotions on a 9-point scale. As an effect of objectivity, subjective descriptions induced significantly higher emotion ratings than objective ones in Experiment 1, in which prior context was given minimally. In Experiment 2 which provided more faithful contextual information, however, perceived character emotion tended to be greater for objective appraisals, possibly suggesting that objective descriptions along with abundant context help the listeners actively reconstruct mental representations for the intended psychological states. The effects of prosody were more robust across the experiments. The ratings significantly increased when provided with more salient acoustic cues for the phrase boundary and prominence, highlighting the role of prosodically-driven articulatory strengthening in speech perception, which may be provided as a guideline for trained dubbing artists.

참고문헌 (21)

  1. 김태경, "시각장애인을 위한 미디어에 관한 연구", 석사, 뉴미디어음악학, pp.2010
  2. 김혜원, "시각장애인을 위한 배리어프리영화의 국내 제작현황 및 표현양식 연구 - 한국 다큐멘터리 영화 <달팽이의 별>을 중심으로", 영상문화콘텐츠연구, (6), pp.105~136 (2013), 영상문화콘텐츠연구원
  3. 김호연, "장애인 방송 접근권 연구 : 시각장애인의 화면해설방송을 중심으로", 시각장애연구, 25(4), pp.85~105 (2009), 한국시각장애교육&재활학회
  4. 양병곤, "외국어 발음 교육과 연구를 위한 소프트웨어 kalvin 활용", 부산대사대논문집, 43, pp.17~30 (2004)
  5. 장애인방송 편성현황 검증·분석 및 평가방안 연구, "이동훈", ~, pp.방송통신정책연구 11-진흥-다-21 (2011)
  6. 이상빈, "화면해설(audio description)에서의 객관성 개념 분석: 지침, 연구자, 작가의 관점을 중심으로", 번역학연구, 20(3), pp.119~150 (2019), 한국번역학회[DOI]
  7. 이상빈, "화면해설에서의 객관성과 인물의 심리·감정 표현: 배리어프리영화 『앙리 앙리』(Henri Henri)를 기반으로", 번역학연구, 21(1), pp.139~158 (2020), 한국번역학회[DOI]
  8. 이영희, "화면해설영상의 영화기호학적 접근 - 크리스티앙 메츠 이론의 관점으로 -", 시각장애연구, 35(1), pp.145~160 (2019), 한국시각장애교육&재활학회[DOI]
  9. 이재진, "매체이용자로서의 시각장애인을 위한 화면해설서비스의 법제도적 현실과 개선점", 미디어 경제와 문화, 13(1), pp.54~100 (2015), (주)에스비에스
  10. Chmiel, Agnieszka, "Emerging Topics in Translation: Audio Description", pp.57~80 (2012), EUT Edizioni Università di Trieste
  11. Cho, Taehong, "Prosodic Boundary Strengthening in the Phonetics- Prosody Interface", Language and Linguistics Compass, 10(3), pp.120~141 (2016)
  12. Korean Linguistics 29, "Japanese", pp.2022, Cho, Taehong
  13. Cho, Taehong, "Articulatory and Acoustic Studies of Domain-Initial Strengthening in Korean", Journal of Phonetics, 29, pp.155~190 (2001)
  14. Jun, Sun-Ah, "The Phonetics and Phonology of Korean Prosody", PhD, pp.1993
  15. Jun, Sun-Ah, "The Accentual Phrase in the Korean Prosodic Hierarchy", Phonology, 15(2), pp.189~226 (1998)
  16. Jun, Sun-Ah, "K-ToBI (Korean ToBI) Labelling Conventions: Version 3", Speech Sciences, 7, pp.143~169 (2000)
  17. Jun, Sun-Ah, "Tones and Tunes: Studies in Word and Sentence Prosody", pp.143~167 (2007), Mouton de Gruyter
  18. Jun, Sun-Ah, "Prosodic Typology II: The Phonology of Intonation and Phrasing" (2014), Oxford UP
  19. Kleege, Georgina, "Audio Description Described: Current Standards, Future Innovations, Larger Implications", Representations, 135(1), pp.89~101 (2015)
  20. Martin, James R., "The Language of Evaluation: Appraisal in English" (2005), Palgrave Macmillan
  21. Oh, Sejin, "The Prosodic Structure and the Underlying Tonal Pattern of AP in Chungnam Korean", Proceedings of HISPhonCog, 2, pp.175~176 (2019), Hanyang University

관련 논문AI추천

이 간행물의 다른 논문 (5건)