심리 화면해설의 객관성과 발화 운율이 등장인물의 감정 이해에 미치는 영향
Influences of Objectivity and Prosody in Audio Description on the Comprehension of Character Emotions
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
This study presents results from two speech perception experiments to provide empirical evidence for improving perceptual clarity in audio descriptions (AD) for character emotions. In both experiments, 27 participants with normal vision heard AD-style utterances that varied in objectivity of appraisals (i.e., words denoting emotion vs. words describing behavior) and in prosodic saliency of the appraisals, and then self-rated the degree of perceived emotions on a 9-point scale. As an effect of objectivity, subjective descriptions induced significantly higher emotion ratings than objective ones in Experiment 1, in which prior context was given minimally. In Experiment 2 which provided more faithful contextual information, however, perceived character emotion tended to be greater for objective appraisals, possibly suggesting that objective descriptions along with abundant context help the listeners actively reconstruct mental representations for the intended psychological states. The effects of prosody were more robust across the experiments. The ratings significantly increased when provided with more salient acoustic cues for the phrase boundary and prominence, highlighting the role of prosodically-driven articulatory strengthening in speech perception, which may be provided as a guideline for trained dubbing artists.
Abstract
This study presents results from two speech perception experiments to provide empirical evidence for improving perceptual clarity in audio descriptions (AD) for character emotions. In both experiments, 27 participants with normal vision heard AD-style utterances that varied in objectivity of appraisals (i.e., words denoting emotion vs. words describing behavior) and in prosodic saliency of the appraisals, and then self-rated the degree of perceived emotions on a 9-point scale. As an effect of objectivity, subjective descriptions induced significantly higher emotion ratings than objective ones in Experiment 1, in which prior context was given minimally. In Experiment 2 which provided more faithful contextual information, however, perceived character emotion tended to be greater for objective appraisals, possibly suggesting that objective descriptions along with abundant context help the listeners actively reconstruct mental representations for the intended psychological states. The effects of prosody were more robust across the experiments. The ratings significantly increased when provided with more salient acoustic cues for the phrase boundary and prominence, highlighting the role of prosodically-driven articulatory strengthening in speech perception, which may be provided as a guideline for trained dubbing artists.
참고문헌 (21)
- 김태경, "시각장애인을 위한 미디어에 관한 연구", 석사, 뉴미디어음악학, pp.2010
- 김혜원, "시각장애인을 위한 배리어프리영화의 국내 제작현황 및 표현양식 연구 - 한국 다큐멘터리 영화 <달팽이의 별>을 중심으로", 영상문화콘텐츠연구, (6), pp.105~136 (2013), 영상문화콘텐츠연구원
- 김호연, "장애인 방송 접근권 연구 : 시각장애인의 화면해설방송을 중심으로", 시각장애연구, 25(4), pp.85~105 (2009), 한국시각장애교육&재활학회
- 양병곤, "외국어 발음 교육과 연구를 위한 소프트웨어 kalvin 활용", 부산대사대논문집, 43, pp.17~30 (2004)
- 장애인방송 편성현황 검증·분석 및 평가방안 연구, "이동훈", ~, pp.방송통신정책연구 11-진흥-다-21 (2011)
- 이상빈, "화면해설(audio description)에서의 객관성 개념 분석: 지침, 연구자, 작가의 관점을 중심으로", 번역학연구, 20(3), pp.119~150 (2019), 한국번역학회[DOI]
- 이상빈, "화면해설에서의 객관성과 인물의 심리·감정 표현: 배리어프리영화 『앙리 앙리』(Henri Henri)를 기반으로", 번역학연구, 21(1), pp.139~158 (2020), 한국번역학회[DOI]
- 이영희, "화면해설영상의 영화기호학적 접근 - 크리스티앙 메츠 이론의 관점으로 -", 시각장애연구, 35(1), pp.145~160 (2019), 한국시각장애교육&재활학회[DOI]
- 이재진, "매체이용자로서의 시각장애인을 위한 화면해설서비스의 법제도적 현실과 개선점", 미디어 경제와 문화, 13(1), pp.54~100 (2015), (주)에스비에스
- Chmiel, Agnieszka, "Emerging Topics in Translation: Audio Description", pp.57~80 (2012), EUT Edizioni Università di Trieste
- Cho, Taehong, "Prosodic Boundary Strengthening in the Phonetics- Prosody Interface", Language and Linguistics Compass, 10(3), pp.120~141 (2016)
- Korean Linguistics 29, "Japanese", pp.2022, Cho, Taehong
- Cho, Taehong, "Articulatory and Acoustic Studies of Domain-Initial Strengthening in Korean", Journal of Phonetics, 29, pp.155~190 (2001)
- Jun, Sun-Ah, "The Phonetics and Phonology of Korean Prosody", PhD, pp.1993
- Jun, Sun-Ah, "The Accentual Phrase in the Korean Prosodic Hierarchy", Phonology, 15(2), pp.189~226 (1998)
- Jun, Sun-Ah, "K-ToBI (Korean ToBI) Labelling Conventions: Version 3", Speech Sciences, 7, pp.143~169 (2000)
- Jun, Sun-Ah, "Tones and Tunes: Studies in Word and Sentence Prosody", pp.143~167 (2007), Mouton de Gruyter
- Jun, Sun-Ah, "Prosodic Typology II: The Phonology of Intonation and Phrasing" (2014), Oxford UP
- Kleege, Georgina, "Audio Description Described: Current Standards, Future Innovations, Larger Implications", Representations, 135(1), pp.89~101 (2015)
- Martin, James R., "The Language of Evaluation: Appraisal in English" (2005), Palgrave Macmillan
- Oh, Sejin, "The Prosodic Structure and the Underlying Tonal Pattern of AP in Chungnam Korean", Proceedings of HISPhonCog, 2, pp.175~176 (2019), Hanyang University
