Comparison of McGurk Effect across Three Consonant-Vowel Combinations in Kannada
3
조회
0
다운로드
0
인용
0
참고문헌
초록
Background and Objectives: The influence of visual stimulus on the auditory component inthe perception of auditory-visual (AV) consonant-vowel syllables has been demonstrated in differentlanguages. Inherent properties of unimodal stimuli are known to modulate AV integration. The present study investigated how the amount of McGurk effect (an outcome of AV integration)varies across three different consonant combinations in Kannada language. Theimportance of unimodal syllable identification on the amount of McGurk effect was also seen. Subjects and Methods: Twenty-eight individuals performed an AV identification task with ba/ga, pa/ka and ma/n· a consonant combinations in AV congruent, AV incongruent (McGurkcombination), audio alone and visual alone condition. Cluster analysis was performed usingthe identification scores for the incongruent stimuli, to classify the individuals into two groups;one with high and the other with low McGurk scores. The differences in the audio alone andvisual alone scores between these groups were compared. Results: The results showed significantlyhigher McGurk scores for ma/n· a compared to ba/ga and pa/ka combinations inboth high and low McGurk score groups. No significant difference was noted between ba/gaand pa/ka combinations in either group. Identification of /n· a/ presented in the visual alonecondition correlated negatively with the higher McGurk scores. Conclusions: The results suggestthat the final percept following the AV integration is not exclusively explained by the unimodalidentification of the syllables. But there are other factors which may also contribute tomaking inferences about the final percept.
Abstract
Background and Objectives: The influence of visual stimulus on the auditory component inthe perception of auditory-visual (AV) consonant-vowel syllables has been demonstrated in differentlanguages. Inherent properties of unimodal stimuli are known to modulate AV integration. The present study investigated how the amount of McGurk effect (an outcome of AV integration)varies across three different consonant combinations in Kannada language. Theimportance of unimodal syllable identification on the amount of McGurk effect was also seen. Subjects and Methods: Twenty-eight individuals performed an AV identification task with ba/ga, pa/ka and ma/n· a consonant combinations in AV congruent, AV incongruent (McGurkcombination), audio alone and visual alone condition. Cluster analysis was performed usingthe identification scores for the incongruent stimuli, to classify the individuals into two groups;one with high and the other with low McGurk scores. The differences in the audio alone andvisual alone scores between these groups were compared. Results: The results showed significantlyhigher McGurk scores for ma/n· a compared to ba/ga and pa/ka combinations inboth high and low McGurk score groups. No significant difference was noted between ba/gaand pa/ka combinations in either group. Identification of /n· a/ presented in the visual alonecondition correlated negatively with the higher McGurk scores. Conclusions: The results suggestthat the final percept following the AV integration is not exclusively explained by the unimodalidentification of the syllables. But there are other factors which may also contribute tomaking inferences about the final percept.
참고문헌 (30)
- McGurk H, "Hearing lips and seeing voices", Nature, 264, pp.746~748 (1976)
- Brancazio L, "Visual influences on the internal structure of phonetic categories", Percept Psychophys, 65, pp.591~601 (2003)
- van Wassenhove V, "Temporal window of integration in auditory-visual speech perception", Neuropsychologia, 45, pp.598~607 (2007)
- Tiippana K., "What is the McGurk effect?", Front Psychol, 5, pp.725~ (2014)
- Benoit MM, "Primary and multisensory cortical activity is correlated with audiovisual percepts", Hum Brain Mapp, 31, pp.526~538 (2010)
- Mallick DB, "Variability and stability in the McGurk effect: contributions of participants, stimuli, time, and response type", Psychon Bull Rev, 22, pp.1299~1307 (2015)
- Strand J, "Individual differences in susceptibility to the McGurk effect: links with lipreading and detecting audiovisual incongruity", J Speech Lang Hear Res, 57, pp.2322~2331 (2014)
- Colin C, "The role of sound intensity and stop-consonant voicing on McGurk fusions and combinations", Eur J Cogn Psychol, 14, pp.475~491 (2002)
- MacDonald J, "Visual influences on speech perception processes", Percept Psychophys, 24, pp.253~257 (1978)
- Sekiyama K, "McGurk effect in non-English listeners:few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility", J Acoust Soc Am, 90(4 Pt 1), pp.1797~1805 (1991)
- Marques LM, "Multisensory integration processes underlying speech perception as revealed by the McGurk illusion", Lang Cogn Neurosci, 31, pp.1115~1129 (2016)
- Zhang J, "Combining behavioral and ERP methodologies to investigate the differences between Mc-Gurk effects demonstrated by Cantonese and Mandarin speakers", Front Hum Neurosci, 12, pp.181~ (2018)
- Upadhyaya UP, "Kannada phonetic reader" (1972), Central Institute of Indian Languages
- Roa Romero Y, "Early and late beta-band power reflect audiovisual perception in the McGurk illusion", J Neurophysiol, 113, pp.2342~2350 (2015)
- Venezia JH, "Timing in audiovisual speech perception: a mini review and new psychophysical data", Atten Percept Psychophys, 78, pp.583~601 (2016)
- Clopper CG, "Some acoustic cues for the perceptual categorization of American English regional dialects", J Phon, 32, pp.111~140 (2004)
- Green KP, "Acoustic cues to place of articulation and the McGurk effect: the role of release bursts, aspiration, and formant transitions", J Speech Lang Hear Res, 40, pp.646~665 (1997)
- Jiang J, "Psychophysics of the McGurk and other audiovisual speech integration effects", J Exp Psychol Hum Percept Perform, 37, pp.1193~1209 (2011)
- Saalasti S, "Audiovisual speech perception and eye gaze behavior of adults with asperger syndrome", J Autism Dev Disord, 42, pp.1606~1615 (2012)
- Tiippana K, "Visual attention modulates audiovisual speech perception", Eur J Cogn Psychol, 16, pp.457~472 (2004)
- Grant KW, "Measures of auditory-visual integration in nonsense syllables and sentences", J Acoust Soc Am, 104, pp.2438~2450 (1998)
- Massaro DW, "Tests of auditory-visual integration efficiency within the framework of the fuzzy logical model of perception", J Acoust Soc Am, 108, pp.784~789 (2000)
- Norrix LW, "Auditory-visual integration for speech by children with and without specific language impairment", J Speech Lang Hear Res, 50, pp.1639~1651 (2007)
- Phatak SA, "Consonant confusions in white noise", J Acoust Soc Am, 124, pp.1220~1233 (2008)
- Phatak SA, "Consonant and vowel confusions in speechweighted noise", J Acoust Soc Am, 121, pp.2312~2326 (2007)
- Jayaram M., "Sound and syllable distribution in written Kannada and their application to speech and hearing", J India Inst Speech Hear, 16, pp.19~30 (1985)
- Sreedevi N, "Frequency of occurence of phonemes in Kannada: a preliminary study", J All India Ins Speech Hear, 31, pp.40~46 (2012)
- Burnham D, "Language-general auditory-visual speech perception:Thai-English and Japanese-English McGurk effects", Multisensory Res, 31, pp.79~110 (2018)
- Massaro DW, "Bimodal speech perception:an examination across languages", J Phon, 21, pp.445~478 (1993)
- van Wassenhove V., "Speech through ears and eyes: interfacing the senses with the supramodal brain", Front Psychol, 4, pp.388~ (2013)