Improved Melody Recognition Performance of a Cochlear Implant Speech Processing Strategy Using Instantaneous Frequency Encoding Based on Teager Energy Operator
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
We present a speech processing strategy incorporating instantaneous frequency (IF) encoding for the enhancement of melody recognition performance of cochlear implants. For the IF extraction from incoming sound, we propose the use of a Teager energy operator (TEO), which is advantageous for its lower computational load. From time-frequency analysis, we verified that the TEO-based method provides proper IF encoding of input sound, which is crucial for melody recognition. Similar benefit could be obtained also from the use of a Hilbert transform (HT), but much higher computational cost was required. The melody recognition performance of the proposed speech processing strategy was compared with those of a conventional strategy using envelope extraction, and the HT-based IF encoding. Hearing tests on normal subjects were performed using acoustic simulation and a musical contour identification task. Insignificant difference in melody recognition performance was observed between the TEO-based and HT-based IF encodings, and both were superior to the conventional strategy. However, the TEO-based strategy was advantageous considering that it was approximately 35% faster than the HT-based strategy.
Abstract
We present a speech processing strategy incorporating instantaneous frequency (IF) encoding for the enhancement of melody recognition performance of cochlear implants. For the IF extraction from incoming sound, we propose the use of a Teager energy operator (TEO), which is advantageous for its lower computational load. From time-frequency analysis, we verified that the TEO-based method provides proper IF encoding of input sound, which is crucial for melody recognition. Similar benefit could be obtained also from the use of a Hilbert transform (HT), but much higher computational cost was required. The melody recognition performance of the proposed speech processing strategy was compared with those of a conventional strategy using envelope extraction, and the HT-based IF encoding. Hearing tests on normal subjects were performed using acoustic simulation and a musical contour identification task. Insignificant difference in melody recognition performance was observed between the TEO-based and HT-based IF encodings, and both were superior to the conventional strategy. However, the TEO-based strategy was advantageous considering that it was approximately 35% faster than the HT-based strategy.
참고문헌 (23)
- B.Wilson, "Improved speech recognition with cochlear implants", Nature, 352, pp.236~238 (1991)
- P.C.Loizou, "Mimicking the human ear", Signal Processing Magazine,IEEE, 15, pp.101~130 (1998)
- P.Loizou,M.Dorman, "On the number of channels needed to understand speech", J.Acoust.Soc.AM., 106, pp.2097~2103 (1999)
- B.S.Wilsonand, "Two new directions in speech processor design for cochlear implants", Ear.Hearing, 26, pp.73~81 (2005)
- Z.M.Smith, "Chimaeric sounds reveal dichotomies in auditory perception", Nature, 416, pp.87~90 (2002)
- S.Brill,A.Moltner, "Temporal fine structure coding in low frequency channels:speech and prosody understanding,pitch and music perception and subjective benefit evaluated in a prospective randomized study", presented at 2007 Conference on Implantable Auditory Prostheses (2007), Lake Tahoe
- W.R.Drennan, "Discrimination of Schroeder-phase harmonic complexes by normal-hearing and cochlear-implant listeners", J.Assoc.Res.Otolaryngol., 9, pp.138~149 (2008)
- W.R.Drennan, "Effects of temporal fine structure on the lateralization of speech and on speech understanding in noise", J.Assoc.Res.Otolaryngol., 8, pp.373~383 (2007)
- F.Zeng, "Speech recognition withamplitude and frequency modulations", Proc.Natl.Acad.Sci.USA,, 102, pp.2293~2298 (2004)
- K.Nie, "Encoding frequency modulation to improve cochlear implant performance in noise", IEEE Trans.Biomed.Eng., 52, pp.64~73 (2004)
- R.E.Ziemer, "Tranter,Principles of Communications" (2001), Wiley
- J.F.Kaiser, "On a simple algorithm to calculate the energy of a signal", in Proc.IEEE Int.Conf.Acoustics,Speech,Signal Processing, 1, pp.381~384 (1990)
- P.Maragos, "Energy separation in signal modulations with application to speech analysis", IEEE Trans.Signal Process., 41, pp.3024~3050 (1993)
- A.Potamianos, "A comparison of the energy operator and the Hilbert transform approach to signal and speech demodulation", Signal Process., 37, pp.95~120 (1994)
- J.H.Galvin, "Melodic contour identification by cochlear implant listeners", Ear and Hear., 28, pp.302~310 (2007)
- S.Bandyopadhyay, "Discrimination of voiced stop consonants based on auditory nerve discharges", J.Neurosci., 24, pp.531~541 (2004)
- E.D.Young, "Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers", J.Acoust.Soc.Am., 66, pp.1381~1403 (1979)
- A.R.Palmer, "The representation of steady-state vowel sounds in the temporal discharge patterns of the guinea pig cochlear nerve and primary-like cochlear nucleus neurons", J.Acoust.Soc.Am., 79, pp.100~113 (1986)
- B.K.Yang, "An Acoustical Study of Korean Diphthongs", MALSORI(in Korean), 25, pp.3~26 (1993)
- Y.Kong, "Temporal and spectral cues in Mandarin tone recognition", J.Acoust.Soc.AM., 120, pp.2830~2840 (2006)
- K.Nie, "Encoding frequency modulation to improve cochlear implant performance in noise", IEEE Trans.on Biomedical Engineering, 52, pp.64~73 (2005)
- C.S.Throckmortona, "Acoustic model investigation of a multiple carrier frequency algorithm for encoding fine frequency structure:Implications for cochlear implants", Hearing Research, 218(1), pp.30~42 (2006)
- R Schatzer, "Temporal fine structure in cochlear implants:preliminary speech perception results in Cantonese-speaking implant users", Acta Otolaryngol., 130(9), pp.1031~1039 (2010)