코퍼스에 기반을 둔 일본어 언어행동 연구방법론 비교 고찰 -멀티모달 코퍼스와 멀티미디어 코퍼스를 중심으로-

Abstract

In situations that include face-to-face utterances, the overall action of delivering information through verbal and non-verbal language (i.e., gaze, gesture, facial expression, and tone) is called “expressive behavior.” I compared the characteristics of that are commonly employed in expressive behavior research. Both types of corpus allow an examination of the images and voices of an utterance and include non-verbal language that is obtained from them as well as verbal language. However, the comparison revealed the following results. From the non-verbal language perspective, research that adopts multimodal corpora focuses on proving that various modes, including verbal language, gesture, and gaze, function dynamically in interactions between the speaker and listener as, for example, with turn-taking. In comparison, from the verbal language perspective, research that adopts multimedia corpora focuses on extracting patterned inclinations regarding the influences caused by the speaker’s verbal language in reciprocity to various elements (e.g., non-verbal language, the speaker’s generic characteristics, and information delivered by the utterance) that are related to expressive behavior. The difference in the focuses of the two types of corpus is distinctly reflected in the methods employed to collect the corpus data, and construct and utilize the corpus.