다면성과 다면 말뭉치에 대하여 - 다면 말뭉치 개발을 위한 기초 연구 -
Multimodality and Multimodal Corpus
0
조회
0
다운로드
5
인용
0
참고문헌
키워드
초록
This paper investigates the definitions and methods for developing multimodal spoken corpus. Facial expression, hand gestures, body gestures,and head movement will provide us essential information to understand spoken discourse as much as phonological, morphological, syntactic and semantic cues do. Thus for computer-based interpretation of human face-to-face dialogue, it is important to construct corpora which store those variety of multimodal information. We examines how multimodality is defined and analyzed in the previous studies and defines multimodal spoken corpus. We also discuss some issues to keep in mind when creating and analyzing a multimodal corpus. Finally, we describe how to transcribe and analyze multimodal data using the ELAN annotation tool.
Abstract
This paper investigates the definitions and methods for developing multimodal spoken corpus. Facial expression, hand gestures, body gestures,and head movement will provide us essential information to understand spoken discourse as much as phonological, morphological, syntactic and semantic cues do. Thus for computer-based interpretation of human face-to-face dialogue, it is important to construct corpora which store those variety of multimodal information. We examines how multimodality is defined and analyzed in the previous studies and defines multimodal spoken corpus. We also discuss some issues to keep in mind when creating and analyzing a multimodal corpus. Finally, we describe how to transcribe and analyze multimodal data using the ELAN annotation tool.
참고문헌 (23)
- 김현강, "담화 자료의 비언어적 요소의 전사 방법 연구", 어문론총, (53), pp.85~106 (2010), 한국문학언어학회
- 서상규, "한국어 구어 연구(1)-구어 전사 말뭉치와 그 활용" (2002), 한국문화사
- 서상규, "구어 말뭉치 설계의 몇 가지 조건, 언어정보와 사전편찬 14~16합집", pp.5~29 (2005), 연세대 언어정보연구원
- 이용희, "지능형 사용자 인터페이스를 위한 멀티모달 상호작용 프레임워크", 한국정보기술학회 하계학술대회 논문집, pp.381~386 (2007), 한국정보기술학회
- 임미정, "멀티모달 인터랙션을 위한 사용자 병렬 모달리티 입력방식 및 입력 동기화 방법 설계", 대한인간공학회지, 25(2), pp.135~146 (2006), 대한인간공학회
- 정현선, "언어·텍스트·매체 ·문화'범주와 '복합 문식성'개념을 통한미디어교육의 국어교육적 수용에 관한 연구", 한국초등국어교육, (28), pp.307~338 (2005), 한국초등국어교육학회
- 정혜승, "문식성(literacy)의 변화와 기호학적 관점의 국어과 교육과정 모델", 교육과정연구, 26(4), pp.149~172 (2008), 한국교육과정학회
- 홍희영, "FACS에 의한 한국 영아의 미소 얼굴 표정 분석 연구", 한국심리학회지: 발달, 16(3), pp.155~172 (2003), 한국심리학회 산하 한국발달심리학회
- 金子拓也, "マルチーダル対話コーパスの構築", 信学技報, 99(3), pp.17~23 (1999), 電子情 報通信学会
- Allwood,J, "Multimodal Corpora. In Corpus Linguistics: An International Handbook Vol.1", pp.207~224 (2008), Walter de Gruyter
- Allwood, J., "The MUMIN Multimodal Coding Scheme. In NorFA yearbook" (2005)
- Aran, O., "A Multimodal Corpus for Studying Dominance in Small Group Conversations", Proceedings of the 7th International Workshop Series on Multimodal Corpora, Advances in Capturing, Coding and Analyzing Multimodality, pp.22~26 (2010)
- Baldry, Anthony, "Multimodal Transcription and Text Analysis" (2006), Equinox
- Battersby, S, "Using head movement to detect listener responses during multi-party dialogue", Proceedings of the 7th International Workshop Series on Multimodal Corpora, Advances in Capturing, Coding and Analyzing Multimodality, pp.11~15 (2010)
- Colleta, J., "Multi-track Annotation of Child Language and Gestures, In Multimodal Corpora", pp.54~72 (2009), Springer
- Kipp, M., "Multimodal Corpora" (2009), Springer
- Knight,D, "A Multi-modal Corpus Approach to the Analysis Backchanneling Behaviors", 석사, pp.2009
- Kress, G, "Multimodal Discourse: The Modes and Media of Contemporary Communication" (2001), Hodder Arnold
- Matthiessen, Christian M. I. M, "The Multimodal Page: A Systemic Functional Exploration, In New directions in multimodal discourse analysis", pp.1~62 (2006), Erlbaum
- Norris,S, "Analyzing Multimodal Interaction: a Methodological Framework" (2004), Routledge
- O’Halloran, K, "Multimodal Discourse Analysis: Systemic Functional Perspectives" (2004), Continuum
- O’Halloran, K., "Digital Semiotics", Proceedings 10th IASS-AIS, Spain (2009)
- Paggio, P, "Feedback in head gesture and speech", Proceedings of the 7th International Workshop Series on Multimodal Corpora, Advances in Capturing, Coding and Analyzing Multimodality, pp.1~5 (2010)