본문 바로가기
KERD
논문KCI 등재

한국어 화자의 영어 양순음 /b/와 순치음 /v/식별에서 시각 단서의 효과

The Effect of Visual Cues in the Identification of the English Consonants /b/ and /v/ by Native Korean Speakers

0

조회

0

다운로드

2

인용

0

참고문헌

키워드

주제분류학제간연구

초록

This study investigated whether native Korean listeners could use visual cues for the identification of the English consonants /b/ and /v/. Both auditory and audiovisual tokens of word minimal pairs in which the target phonemes were located in word-initial or word-medial position were used. Participants were instructed to decide which consonant they heard in 2 x 2conditions: cue (audio-only, audiovisual) and location (word-initial, word-medial). Mean identification scores were significantly higher for audiovisual than audio-only condition and for word-initial than word-medial condition. Also, according to signal detection theory, sensitivity, d´, and response bias, c were calculated based on both hit rates and false alarm rates. The measures showed that the higher identification rate in the audiovisual condition was related with an increase in sensitivity. There were no significant differences in response bias measures across conditions. This result suggests that native Korean speakers can use visual cues while identifying confusing non-native phonemic contrasts. Visual cues can enhance non-native speech perception.

Abstract

This study investigated whether native Korean listeners could use visual cues for the identification of the English consonants /b/ and /v/. Both auditory and audiovisual tokens of word minimal pairs in which the target phonemes were located in word-initial or word-medial position were used. Participants were instructed to decide which consonant they heard in 2 x 2conditions: cue (audio-only, audiovisual) and location (word-initial, word-medial). Mean identification scores were significantly higher for audiovisual than audio-only condition and for word-initial than word-medial condition. Also, according to signal detection theory, sensitivity, d´, and response bias, c were calculated based on both hit rates and false alarm rates. The measures showed that the higher identification rate in the audiovisual condition was related with an increase in sensitivity. There were no significant differences in response bias measures across conditions. This result suggests that native Korean speakers can use visual cues while identifying confusing non-native phonemic contrasts. Visual cues can enhance non-native speech perception.

참고문헌 (18)

  1. 최양규, "조음위치에 관한 시각정보가 말소리 지각에 미치는 영향: 한국인의 McGurk 효과", 언어치료연구, 13(2), pp.117~128 (2004), 한국언어치료학회
  2. Dennis, S., "Bayesian analysisof recognition memory: The case of the list-length effect", Journal of Memory and Language, 59, pp.361~376 (2008)
  3. Forster, K. I, "DMDX : A Windows displayprogram with millisecond accuracy", Behavior ResearchMethods, 35, pp.116~124 (2003)
  4. Grant, K. W., "Measures of auditory-visualintegration in nonsense syllables and sentences", The Journal ofthe Acoustical Society of America, 104, pp.2438~2450 (1998)
  5. Hardison, D. M., "Acquisition of second-language speech : Effects of visual cues, context, and talker variability", AppliedPsycholinguistics, 24, pp.495~522 (2003)
  6. Hazan, V., "Effectof audiovisual perceptual training on the perception andproduction of consonants by Japanese learners of English", Speech Communication, 47, pp.360~378 (2005)
  7. Hazan, V., "The use of visual cues in theperception of non-native consonant contrasts", The Journal ofthe Acoustical Society of America, 119, pp.1740~1751 (2006)
  8. Iverson, P., "A perceptualinterference account of acquisition difficulties for non-nativephonemes", Cognition, 87, pp.47~57 (2003)
  9. Kuhl, P. K., "The bimodal perception ofspeech in infancy", Science, 218, pp.1138~1141 (1982)
  10. Lee, M. D., "BayesSDT : Software for Bayesian inferencewith signal detection theory", Behavior Research Methods, 40, pp.450~456 (2008)
  11. Logan, J., "Training Japaneselisteners to identify English", r, l, pp.: A first report, The Journal of the Acoustical Society of America[DOI]
  12. Macmillan, N, "Detection theory: A user'sguide" (2005), Lawrence Erlbaum Assoc. Inc
  13. McGurk, H., "Hearing lips and seeingvoi", Nature, 264, pp.746~748 (1976)
  14. Schmidt, A. M., "Cross-language identification ofconsonants. Part 1. Korean perception of English", The Journalof the Acoustical Society of America, 99, pp.3201~3211 (1996)
  15. Sekiyama, K., "Cultural and linguistic factors in audiovisualspeech processing : the McGurk effect in Chinese subjects", Perception & Psychophysics, 59, pp.73~80 (1997)
  16. Sekiyama, K, "Impact of language ondevelopment of auditory visual speech perception", Developmental Science, 11, pp.306~320 (2008)
  17. Sekiyama, K, "McGurk effect innon-English listeners : Few visual effects for Japanese subjectshearing Japanese syllables of high auditory intelligibility", The Journal of the Acoustical Society of America, 90, pp.1797~1805 (1991)
  18. Sumby, W. H., "Visual contribution to speechintelligibility in noise", The Journal of the Acoustical Society of America, 26, pp.212~215 (1954)

관련 논문AI추천

이 간행물의 다른 논문 (19건)