입 움직임 시각 단서가 청각 언어 지각에 미치는 영향: 구조 방정식 모델 연구
The influence of visual mouth cue on auditory speech perception: Structural Equation modeling
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
본 연구는 시청각 언어 지각 중에 관여하는 우반구의 두뇌 영역들의 신경망을 제안하고, 그 신경망 내의 연결 관계가 청각 문장과 함께 제시되는 화자의 입 움직임 시각적 단서들의 속성에 따라 어떻게 변화하는 지를 탐색한 연구이다. 이 신경망 연구는 정상 청력을 가진 성인(N=12)이 청각 문장의 진위를 판단하는 과제를 수행하는 중에 청각 언어 자극과 함께 제시되는 서로 다른 시각 자극 조건(다문 입 모양, 껌 씹는 입 움직임, 청각 문장 자극과 일치하는 입 움직임)에 따라 다르게 활성화 되는 영역을 관찰한 사전 fMRI 연구 결과를 자료로 하였다. 우반구의 전측 및 후측의 상 측두구, 좌측 Broca에 대응되는 우측 Broca영역, 그리고 우측 V5/MT 영역들과 시각피질 영역이 본 연구의 관심영역으로 선택되어 경로 분석에 사용되었으며, 구조방정식모형(Structural Equation Modeling)을 이용하여 영역들 간의 경로 관계를 분석한 결과 시각 피질에서 V5/MT영역이 시각 조건과 무관하게 늘 유의한 반면, 입 움직임이 있는 두 조건에서는 V5/MT영역에서 후측 상 측두구로의 경로가, 청각문장과 일치한 입 움직임 조건에서는 후측 상 측두구에서 전측 상 측두구로의 경로가 유의한 것으로 나타났다. 특히 V5/MT영역과 Broca영역 사이의 경로가 조건에 따라 역동적 변화를 보였는데, 입 움직임이 없는 조건에 비해 화자의 무의미한 입 움직임이 제시된 조건에서는 V5/MT영역에서 Broca 영역으로의 경로가 부적에서 정적인 연결로 바뀌는 반면, 그 반대 방향(Broca에서 V5/MT)으로의 경로는 정적에서 부적 연결로 변화하였다. 특히 청각문장과 일치하는 입 움직임 조건에서는 위의 경로들의 연결 강도는 더욱 유의하게 증가하였다. 시청각 문장의 교차양상(cross-modal) 처리 시에 활성화되는 우반구 영역들 간의 네트워크간의 이러한 역동적 변화는, 우반구 회로 내의 선택적 억제과정이 존재할 가능성을 의미한다.
Abstract
Visual cues emitted from a speaker, such as mouth and lip movements, are critical aspects of sensory information that influence auditory speech perception in face to face conversation. The way in which these complex visual cues are processed remains to be elucidated. Here we apply fMRI to a cross-modal speech perception paradigm in order to determine how functional connectivity between brain areas changes depending on the type of visual cue. Data obtained from a previous fMRI study in which three conditions, closed mouth (CM), twitching mouth (TM), or speaking mouth (SM) were delivered during an auditory sentence perception task. Structural Equation Modeling (SEM) was used to estimate functional strengths of links in a network among the brain regions activated in these three conditions. The chosen brain areas, which were modeled only in the right hemisphere, consisted of visual areas (lingual gyrus and V5/MT), both anterior and posterior superior temporal sulci (aSTS and pSTS), and the area equivalent to left Broca’s area (rBroca’s). Significant differences were found for the functional linkages between V5/MT and rBroca’s area across the three conditions. The path from V5/MT to rBroca became positive both during the TM and SM conditions, whereas that in the CM condition was negative. However, the connection from rBroca to V5/MT became negative both during the TM and SM, whereas that in the CM condition was positive. Additional linguistic information, such as the mouth movements of the SM condition, resulted in increased statistical significance of these linkages relative to the TM condition. The dynamic changes in functional connectivity between V5/MT and Broca’s area in the right hemisphere may subserve the cross-modal processing of auditory speech by inhibiting irrelevant or interfering visual cues from mouth movement.
참고문헌 (43)
- 강혜진, "연합기억과제의 특성과 해마활성화에 대한 fMRI 연구", 한국심리학회지:실험, 27, pp.47~498 (2005)
- Allison, T., "Social perception from visual cues:role of the STS region", TrendsCognSci, 4, pp.267~278 (2000)
- Beauchamp,M.S., "See me, hear me, touch me: multisensory intergration in lateral occipital-temporal cortex", Curr Opin Neurobiol, 15, pp.145~153 (2005)
- Bonda, E., "Bonda, E", JNeurosci, 16, pp.3737~3744 (1996)
- Buccino, G., "Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study", EurJNeurosci, 13, pp.400~404 (2001)
- Cabeza, R., "Age-related differences in effective neural connectivity during encoding and recall", NeuroReport, 8, pp.3479~3483 (1997)
- Callan, D.E., "Multimodal contribution to speech perception revealed by independent component analysis: a single?sweep EEG case study", BrainResCognBrainRes, 10, pp.349~353 (2001)
- Calvert, G.A, "Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex", CurrBiol, 10(11), pp.649~657 (2000)
- Calvert, G.A., "Activation of auditory cortex during silent lipreading", Science, 376(5312), pp.593~596 (1997)
- Campbell, R., "Speechreading in the akinetopsic patient", L.M. Brain, 120, pp.1793~1803 (1997)
- Campbell, R., "Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower face acts (gurning)", BrainResCognBrainRes, 2, pp.233~243 (2001)
- Freitag, C.M., "Perception of biological motion in autism spectrum disorders", Neuropsychologia, 46, pp.1480~1494 (2008)
- Friston, K.J., "Functional connectivity: the principal?component analysis of large (PET) data sets", J Cereb Blood Flow Metab, 13, pp.5~14 (1993)
- Frackowiak, R.S., "Human brain function, Second edition" (2004)
- Gallese, V., "Action recognition in the premotor cortex", Brain, 119, pp.593~609 (1996)
- Grossman, E., "Brain areas involved in perception of biological motion", J Cogn Neurosci, 12(5), pp.711~720 (2000)
- Horwitz, B., "Network analysis of brain cognitive function using metabolic and blood flow data", Behav Brain Res, 66, pp.187~193 (1995)
- Howard, R.J, "A direct demonstration of functional specialization within motion?related visual and auditory cortex of the human brain", Curr Biol, 6(8), pp.1015~1019 (1996)
- Kang, E., "The neural correlates of cross-modal interaction in speech perception during a semantic decision task on sentences:A PET study", Neuroimage, 32, pp.423~431 (2006)
- Kang, E., "Visual modulation on speech processing in higher auditory cortices", Society for Neuroscience (2002)
- Kim, H., "Effects of biological motion on speech processing: an fMRI study", Society for Neuroscience (2002)
- Kilts, C.D., "Dissociable neural pathways are involved in the recognition of emotion in static and dynamic facial expressions", Neuroimagei, 18, pp.156~168 (2003)
- Krause, B.J., "Network analysis in episodic encoding and retrieval of word-pair associates: a PET study", Eur J Neurosci, 11(9), pp.3293~3301 (1999)
- Krause, J.B., "Imaging and neural modelling in episodic and working memory processes", Neural Netw, 13(8-9), pp.847~859 (2000)
- Knutson, K.M, "Observing social gestures: an fMRI study", Exp Brain Res, 188(2), pp.187~198 (2008)
- McGurk, H., "Hearing lips and seeing voices", Nature, 26, pp.746~748 (1976)
- McIntosh, A.R., "Structural equation modeling and its application to network analysis in functional brain imaging", Human brain mapping, 2, pp.2~22 (1994)
- McIntosh, A.R., "Network analysis of cortical visual pathways mapped with PET", J Neurosci, 14, pp.655~666 (1994)
- Mogatty, F.M., "Systems level modeling of a neuronal network subserving intrinsic alertness", Neuroimage, 29, pp.225~233 (2006)
- Nyberg, L., "Network analysis of Positron Emisson Tomography regional cerebral blood flow data: ensemble inhibition during episodic memory retrieval", J Neurosci, 16, pp.3753~3759 (1996)
- Pelphrey, K.A., "Functional anatomy of biological motion perception in posterior temporal cortex: an FMRI study of eye, mouth and hand movements", Cereb Cortex, 15(12), pp.1866~1876 (2005)
- Peuskens, H., "Specificity of regions processing biological motion", Eur J Neurosci, 21, pp.2864~2875 (2005)
- Protzner, A.B., "Testing effective connectivity changes with structural equation modeling: what does a bad model tell us?", Human brain mapping, 27, pp.935~947 (2006)
- Puce, A., "Temporal cortex activation in humans viewing eye and mouth movements", J Neurosci, 18, pp.2188~2199 (1998)
- Rees G, "Inattentional blindness versus inattentional amnesia for fixated but ignored words", Science, 286, pp.2504~2507 (1999)
- Rizzolatti, G., "Premotor cortex and the recognition of motor actions", Brain Res Cogn Brain Res, 3, pp.131~141 (1996)
- Sekiyama, K., "Auditory visual speech perception examined by fMRI and PET", Neuro sci Res, 47, pp.277~287 (2003)
- Sekuler, R., "Sound alters visual motion perception", Nature, 385, pp.308~ (1997)
- Seminowicz, D.A., "Limbic-frontal circuitry in major depression:a path modeling metanalysis", NeuroImage, 22, pp.409~418 (2004)
- Shams,L., "Illusion.What you see is what you hear", Nature, 408, pp.788~ (2000)
- Thompson, J.C, "Common and distinct brain activation to viewing dynamic sequences of face and hand movements", Neuroimage, 37(3), pp.966~973 (2007)
- Wheaton, K.J., "Viewing the motion of human body parts activates different regions of premotor, temporal, and parietal cortex", Neuroimage, 22(1), pp.277~288 (2004)
- Winder, R., "Functional connectivity in fMRI:Amodeling approach for estimation and for relating to local circuits", Neuroimage, 34, pp.1093~1107 (2007)