본문 바로가기
KERD
논문KCI 등재

Roles of temporal patterns of vowel-intrinsic cues in model identification of Korean vowels in spontaneous speech

0

조회

0

다운로드

4

인용

0

참고문헌

키워드

주제분류언어학

초록

This study investigates the perceptual roles of temporal patterns of vowel-intrinsic cues to identify Korean diphthong and monophthong signals in spontaneous speech from Seoul Corpus. Formant frequencies of vowel signals were sampled at 20%, 40%, 50%, 60%, and 80% of duration, and were averaged to be represented in the acoustic vowel space. Diphthongs showed two different drastic transitions from the onset to 50% of duration and from 50% to the offset, while monophthongs showed one straight-line transition from the onset to the offset. A neural network pattern recognition classifier was trained and tested on vowel signals, which included diphthongs and monophthongs, with various sets of formant samplings along duration coupled with F3, F0, and/or duration. The results show that three- and four-sample F1 and F2 characterized vowel signals better than one- and two-sample F1 and F2. F3, F0 and duration, when combined, had notable perceptual influences on spectral model identification of vowels.

Abstract

This study investigates the perceptual roles of temporal patterns of vowel-intrinsic cues to identify Korean diphthong and monophthong signals in spontaneous speech from Seoul Corpus. Formant frequencies of vowel signals were sampled at 20%, 40%, 50%, 60%, and 80% of duration, and were averaged to be represented in the acoustic vowel space. Diphthongs showed two different drastic transitions from the onset to 50% of duration and from 50% to the offset, while monophthongs showed one straight-line transition from the onset to the offset. A neural network pattern recognition classifier was trained and tested on vowel signals, which included diphthongs and monophthongs, with various sets of formant samplings along duration coupled with F3, F0, and/or duration. The results show that three- and four-sample F1 and F2 characterized vowel signals better than one- and two-sample F1 and F2. F3, F0 and duration, when combined, had notable perceptual influences on spectral model identification of vowels.

참고문헌 (50)

  1. ADANK, PATRICIA, "Vowel Normalization : A Perceptual-Acoustic Study of Dutch Vowels" (2003), Ponsen & Looijen
  2. AINSWORTH, WILLIAM, "Duration as a cue in the recognition of synthetic vowels", The Journal of the Acoustical Society of America, 51, pp.648~651 (1972)
  3. ANANTHAPADMANABHA T. V., "Intrinsic-cumextrinsic normalization of formant data of vowels", The Journal of the Acoustical Society of America, 140, pp.EL446~EL451 (2016)
  4. ASSMANN, PETER, "Frequency shifts and vowel identification", 15th International Congress of Phonetic Sciences (2003)
  5. ASSMANN, PETER, "Identification of frequency"shifted vowels", The Journal of the Acoustical Society of America, 124, pp.3203~3212 (2008)
  6. BARREDA, SANTIAGO, "The direct and indirect roles of fundamental frequency in vowel perception", The Journal of the Acoustical Society of America, 131, pp.466~477 (2012)
  7. BENNETT, DAVID, "Spectral form and duration as cues in the recognition of English and German vowels", Language and Speech, 11, pp.65~85 (1968)
  8. ". Version 6.0.37" (2018)[URL]
  9. "Stochastic Gradient Descent (v.2)" (2010)[URL]
  10. CUTLER, ANNE, "Patterns of English phoneme confusions by native and non-native listeners", The Journal of the Acoustical Society of America, 116, pp.3668~3678 (2004)
  11. TOMAZ CURK, "Orange: Data mining toolbox in python", Journal of Machine Learning Research, 14, pp.2349~2353 (2013)
  12. FANT, GUNNAR, "Speech Sounds and Features" (1973), MIT Press
  13. FUJISAKI, HIROYA, "The roles of pitch and higher formants in the perception of vowels", IEEE Transactions on Audio and Electroacoustics, 16, pp.73~77 (1968)
  14. GLASBERG, BRIAN, "Derivation of auditory filter shapes from notched-noise data", Hearing Research, 47, pp.103~138 (1990)
  15. GOTTFRIED, MICHAEL, "Three approaches to the classification of American diphthongs", Journal of Phonetics, 21, pp.205~229 (1993)
  16. GOTTFRIED, TERRY, "Intelligibility of vowels sung by a countertenor", The Journal of the Acoustical Society of America, 79, pp.124~130 (1986)
  17. HILLENBRAND, JAMES, "Routledge Handbook of Phonetics", pp.219~263 (2019), Routledge
  18. HILLENBRAND, JAMES, "Some effects of duration on vowel recognition", The Journal of the Acoustical Society of America, 108, pp.3013~3022 (2000)
  19. HILLENBRAND, JAMES, "Vowel classification based on fundamental frequency and formant frequencies", Journal of Speech and Hearing Research, 36, pp.694~700 (1993)
  20. HILLENBRAND, JAMES,, "Acoustic characteristics of American English vowels", The Journal of the Acoustical Society of America, 97, pp.3099~3111 (1995)
  21. HILLENBRAND, JAMES, "Identification of resynthesized", hVd, The Journal of the Acoustical Society of America, pp.1999, 105[DOI]
  22. 홍순현, "Perceptual Influence of Non-Spectral Cues on Spectral Properties of Korean Vowel Signals in Seoul Corpus: A Neural Network Modeling Study", 현대문법연구, (102), pp.135~164 (2019), 현대문법학회[DOI]
  23. 홍순현, "Systematic centralized reduction at the offset of Korean monophthong signals in spontaneous speech", 음성음운형태론연구, 26(3), pp.545~565 (2020), 한국음운론학회[DOI]
  24. 홍순현, "The relative contributions of non-spectral cues to static and dynamic spectral model identification of Korean monophthong signals in Seoul Corpus", 음성음운형태론연구, 26(1), pp.159~184 (2020), 한국음운론학회[DOI]
  25. JENKINS, JAMES, "Identification of vowels in “vowelless” syllable", Perception and Psychophysics, 34, pp.441~450 (1983)
  26. JOHNSON, KEITH, "The role of perceived speaker identity in F0 normalization of vowels", The Journal of the Acoustical Society of America, 88, pp.642~654 (1990)
  27. JOHNSON, KEITH, "The ΔF method of vocal tract length normalization for vowels", Laboratory Phonology : Journal of the Association for Laboratory Phonology, 10, pp.1~16 (2020)
  28. JOOS, MARTIN, "Acoustic phonetics", Language Monographs, 23, pp.5~136 (1948)
  29. KOENIG, WALTER, "A new frequency scale for acoustic measurements", Bell Laboratories Record, 27, pp.299~301 (1949)
  30. LEHISTE, ILSE, "Vowel and speaker identification in natural and synthetic speech", Language Speech, 16, pp.356~364 (1973)
  31. LOBANOV, BORIS, "Classification of Russian vowels spoken by different speakers", The Journal of the Acoustical Society of America, 49, pp.606~608 (1971)
  32. MILLER, JAMES, "Auditory perceptual interpretation of the vowel", The Journal of the Acoustical Society of America, 85, pp.2114~2134 (1989)
  33. MORRISON, GEOFFREY, "Vowel Inherent Spectral Change", pp.31~47 (2013), Springer
  34. NEAREY, TERRANCE., "Phonetic Feature Systems for Vowels" (1978), Indiana University Linguistics Club
  35. NEAREY, TERRANCE, "Modeling the role of inherent spectral change in vowel identification", The Journal of the Acoustical Society of America, 80, pp.1297~1308 (1986)
  36. NEAREY, TERRANCE, "Relationship between fundamental and formant frequencies in voice preference", The Journal of the Acoustical Society of America, 122, pp.EL35~EL43 (2007)
  37. NORDSTRÖM, PER-ERIK, "A normalization procedure for vowel formant data", Proceedings of the 8th International Congress of Phonetic Sciences, 212 (1975)
  38. PETERSEN, STACY, "Accounting for Diphthongs : Duration as Contrast in Vowel Dispersion Theory", PhD, pp.2018
  39. PETERSON, GORDON, "Control methods used in a study of the vowels", The Journal of the Acoustical Society of America, 24, pp.175~184 (1952)
  40. PITERMANN, MICHEL, "Effect of speaking rate and contrastive stress on formant dynamics and vowel perception", The Journal of the Acoustical Society of America, 107, pp.3425~3437 (2000)
  41. POTTER, RALPH, "Towards the specification of speech", The Journal of the Acoustical Society of America, 22, pp.807~820 (1950)
  42. STEVENS, STANLEY, "Measurement: Definitions and Theories", pp.18~63 (1959), John Wiley.
  43. STEVENS, STANLEY, "The relation of pitch to frequency:A revised scale", American Journal of Psychology, 53, pp.329~353 (1940)
  44. STRANGE, WINIFRED, "Dynamic specification of coarticulated vowels", The Journal of the Acoustical Society of America, 74, pp.695~705 (1983)
  45. SYRDAL, ANN, "A perceptual model of vowel recognition based on the auditory representation of American English vowels", The Journal of the Acoustical Society of America, 79, pp.1086~1100 (1986)
  46. TRAUNMULLER, HARTMUT, "Analytical expressions for the tonotopic sensory scale", The Journal of the Acoustical Society of America, 88, pp.97~100 (1990)
  47. WATROUS, RAYMOND, "Current status of Peterson-Barney vowel formant data", The Journal of the Acoustical Society of America, 89, pp.2459~2460 (1991)
  48. 윤태진, "이층위 신경망 모형을 사용한 포먼트 궤적 기반 모음 유형 분류", 음성음운형태론연구, 25(1), pp.95~112 (2019), 한국음운론학회[DOI]
  49. 윤원희, "The Korean Corpus of Spontaneous Speech", 말소리와 음성과학, 7(2), pp.103~109 (2015), 한국음성학회[DOI]
  50. ZAHORIAN, STEPHEN, "Spectral-shape features versus formants as acoustic correlates for vowels", The Journal of the Acoustical Society of America, 94, pp.1966~1982 (1993)

관련 논문AI추천

이 간행물의 다른 논문 (8건)