What Is Temporal Fine Structure and Why Is It Important?
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Complex sound like speech can be characterized as the sum of number of amplitude-modulated signals representing the outputs of an array of narrow frequency bands. Temporal information at the output of each band can be separated into temporal fine structure (TFS), the rapid oscillations close to the center frequency and temporal envelope (ENV), slower amplitude modulations superimposed on the TFS. TFS information can be carried in the pattern of phase locking to the stimulus waveform, while ENV by the changes in firing rate over time. The relative importance of temporal ENV and TFS information in understanding speech has been studied using various sound-processing techniques. A number of studies demonstrated that ENV cues are associated with speech recognition in quiet, while TFS cues are possibly linked to melody/pitch perception and listening to speech in a competing background. However, there are evidences that recovered ENV from TFS as well as TFS itself may be partially responsible for speech recognition. Current technologies used in cochlear implants (CI) are not efficient in delivering the TFS cues, and new attempts have been made to deliver TFS information into sound-processing strategy in CI. We herein discuss the current updated findings of TFS with a literature review.
Abstract
Complex sound like speech can be characterized as the sum of number of amplitude-modulated signals representing the outputs of an array of narrow frequency bands. Temporal information at the output of each band can be separated into temporal fine structure (TFS), the rapid oscillations close to the center frequency and temporal envelope (ENV), slower amplitude modulations superimposed on the TFS. TFS information can be carried in the pattern of phase locking to the stimulus waveform, while ENV by the changes in firing rate over time. The relative importance of temporal ENV and TFS information in understanding speech has been studied using various sound-processing techniques. A number of studies demonstrated that ENV cues are associated with speech recognition in quiet, while TFS cues are possibly linked to melody/pitch perception and listening to speech in a competing background. However, there are evidences that recovered ENV from TFS as well as TFS itself may be partially responsible for speech recognition. Current technologies used in cochlear implants (CI) are not efficient in delivering the TFS cues, and new attempts have been made to deliver TFS information into sound-processing strategy in CI. We herein discuss the current updated findings of TFS with a literature review.
참고문헌 (33)
- Moore BC., "The role of temporal fine structure processing in pitch perception, masking, and speech perception for normal-hearing and hearing-impaired people", J Assoc Res Otolaryngol, 9, pp.399~406 (2008)
- Joris PX., "Responses to amplitude-modulated tones in the auditory nerve of the cat", J Acoust Soc Am, 91, pp.215~232 (1992)
- Drullman R., "Speech intelligibility in noise : relative contribution of speech elements above and below the noise level", J Acoust Soc Am, 98, pp.1796~1798 (1995)
- Hopkins K., "Effects of moderate cochlear hearing loss on the ability to benefit from temporal fine structure information in speech", J Acoust Soc Am, 123, pp.1140~1153 (2008)
- Hopkins K., "The importance of temporal fine structure information in speech at different spectral regions for normal-hearing and hearing-impaired subjects", J Acoust Soc Am, 127, pp.1595~1608 (2010)
- Shannon RV., "Speech recognition with primarily temporal cues", Science, 270, pp.303~304 (1995)
- Won JH., "Spectral-ripple resolution correlates with speech reception in noise in cochlear implant users", J Assoc Res Otolaryngol, 8, pp.384~392 (2007)
- Xu L., "Relative contributions of spectral and temporal cues for phoneme recognition", J Acoust Soc Am, 117, pp.3255~3267 (2005)
- Lorenzi C., "Speech perception problems of the hearing impaired reflect inability to use temporal fine structure", Proc Natl Acad Sci U S A, 103, pp.18866~18869 (2006)
- Smith ZM., "Chimaeric sounds reveal dichotomies in auditory perception", Nature, 416, pp.87~90 (2002)
- Zeng FG., "On the dichotomy in auditory perception between temporal envelope and fine structure cues", J Acoust Soc Am, 116, pp.1351~1354 (2004)
- Ghitza O., "On the upper cutoff frequency of the auditory critical-band envelope detectors in the context of speech perception", J Acoust Soc Am, 110(3 Pt 1), pp.1628~1640 (2001)
- Hopkins K., "The contribution of temporal fine structure to the intelligibility of speech in steady and modulated noise", J Acoust Soc Am, 125, pp.442~446 (2009)
- Qin MK., "Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers", J Acoust Soc Am, 114, pp.446~454 (2003)
- Oxenham AJ., "Correct tonotopic representation is necessary for complex pitch perception", Proc Natl Acad Sci U S A, 101, pp.1421~1425 (2004)
- Moore BC., "Factors affecting thresholds for sinusoidal signals in narrow-band maskers with fluctuating envelopes", J Acoust Soc Am, 82, pp.69~79 (1987)
- Schooneveldt GP., "Comodulation masking release(CMR) : effects of signal frequency, flanking-band frequency, masker bandwidth, flanking-band level, and monotic versus dichotic presentation of the flanking band", J Acoust Soc Am, 82, pp.1944~1956 (1987)
- Hopkins K., "Moderate cochlear hearing loss leads to a reduced ability to use temporal fine structure information", J Acoust Soc Am, 122, pp.1055~1068 (2007)
- Ernst SM., "Mechanisms underlying the detection of frequency modulation", J Acoust Soc Am, 128, pp.3642~3648 (2010)
- Gilbert G., "The ability of listeners to use recovered envelope cues from speech fine structure", J Acoust Soc Am, 119, pp.2438~2444 (2006)
- Ardoint M., "Perception of temporal fine-structure cues in speech with minimal envelope cues for listeners with mild-to-moderate hearing loss", Int J Audiol, 49, pp.823~831 (2010)
- Won JH., "The ability of cochlear implant users to use temporal envelope cues recovered from speech frequency modulation", J Acoust Soc Am, 132, pp.1113~1119 (2012)
- Rubinstein JT., "Pseudospontaneous activity : stochastic independence of auditory nerve fibers with electrical stimulation", Hear Res, 127, pp.108~118 (1999)
- Nie K., "Encoding frequency modulation to improve cochlear implant performance in noise", IEEE Trans Biomed Eng, 52, pp.64~73 (2005)
- Li X., "Improved perception of speech in noise and Mandarin tones with acoustic simulations of harmonic coding for cochlear implants", J Acoust Soc Am, 132, pp.3387~3398 (2012)
- Li X., "Improved perception of music with a harmonic based algorithm for cochlear implants", IEEE Trans Neural Syst Rehabil Eng, 21, pp.684~694 (2013)
- Zeng FG., "Temporal pitch in electric hearing", Hear Res, 174, pp.101~106 (2002)
- Oxenham AJ., "Cochlear compression : perceptual measures and implications for normal and impaired hearing", Ear Hear, 24, pp.352~366 (2003)
- Gatehouse S., "Linear and nonlinear hearing aid fittings--1. Patterns of benefit", Int J Audiol, 45, pp.130~152 (2006)
- Moore BC., "The choice of compression speed in hearing AIDS : theoretical and practical considerations and the role of individual differences", Trends Amplif, 12, pp.103~112 (2008)
- Hopkins K., "The effect of compression speed on intelligibility : simulated hearing-aid processing with and without original temporal fine structure information", J Acoust Soc Am, 132, pp.1592~1601 (2012)
- Lacher-Fougère S., "Consequences of cochlear damage for the detection of interaural phase differences", J Acoust Soc Am, 118, pp.2519~2526 (2005)
- Moore BC., "Development of a fast method for determining sensitivity to temporal fine structure", Int J Audiol, 48, pp.161~171 (2009)