영어 발성에서 초음파 영상 정보를 이용한 인공신경망 기반의 인강부의 추정과 평가 방법에 대한 연구
Artificial Neural Network Prediction of Midsagittal Pharynx Shape from Ultrasound Images for English Speech
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Electromagnetometers (EMA) have been widely used in articulatory studies as their temporal resolution can capture most speech activities and the fleshpoint information allows one to readily quantify and analyze tongue shape. However, the drawback is that the data lacks details of activity in the pharyngeal region. Several studies have attempted to estimate the unknown pharyngeal shape of the tongue, but few studies are based on unimodal data containing both front and back regions of the tongue at the same time. We use Stone’s ball bearing method to obtain fleshpoint data as well as tongue shape. We further introduce a novel way of connecting balls and attaching them onto the tongue to ensure accurate tracking. An Artificial Neural Network is applied to build a map between observable flesh-points, unknown tongue shape, and pharyngeal region and is optimized to efficiently address nonlinearity.
Abstract
Electromagnetometers (EMA) have been widely used in articulatory studies as their temporal resolution can capture most speech activities and the fleshpoint information allows one to readily quantify and analyze tongue shape. However, the drawback is that the data lacks details of activity in the pharyngeal region. Several studies have attempted to estimate the unknown pharyngeal shape of the tongue, but few studies are based on unimodal data containing both front and back regions of the tongue at the same time. We use Stone’s ball bearing method to obtain fleshpoint data as well as tongue shape. We further introduce a novel way of connecting balls and attaching them onto the tongue to ensure accurate tracking. An Artificial Neural Network is applied to build a map between observable flesh-points, unknown tongue shape, and pharyngeal region and is optimized to efficiently address nonlinearity.
참고문헌 (18)
- Byrd, D, "Timing effects of syllable structure and stress on nasals: a real-time MRI examination", Journal of Phonetics, 37, pp.97~110 (2009)
- Gick, B, "The use of ultrasound for linguistic phonetic fieldwork", Journal of the International Phonetic Association, 32(2), pp.113~121 (2002)
- Jackson, M. T. T, "Predicting midsagittal pharyngeal dimensions from measures of anterior tongue position in Swedish vowels: Statistical considerations", Journal of the Acoustical Society of America, 123(1), pp.336~346 (2008)
- Kaburagi, T, "An ultrasonic method for monitoring tongue shape and the position of a fixed-point on the tongue surface", Journal of the Acoustical Society of America, 95(4), pp.2268~2270 (1994)
- Kaburagi, T, "Determination of sagittal tongue shape from the positions of points on the tongue Surface", Journal of the Acoustical Society of America, 96(3), pp.1356~1366 (1994)
- Li, M, "Automatic contour tracking in ultrasound images", Clinical Linguistics and Phonetics, 19(6), pp.545~554 (2005)
- Löfqvist, A, "Tongue body kinematics in velar stop production: influences of consonant voicing and vowel context", Phonetica, 51(1), pp.52~67 (1994)
- Magen, H. S, "Posterior pharyngeal wall position in the production of speech", Journal of Speech, Language, and Hearing Research, 46, pp.241~251 (2003)
- Mitra, V, "Retrieving tract variables from acoustics: a comparison of different Machine Learning strategies", The IEEE Journal of Selected Topics in Signal Processing, 4(6), pp.1027~1045 (2010)
- Parthasarathy, V, "Spatiotemporal visualization of the tongue surface using ultrasound and kriging (SURFACES)", Clinical Linguistics and Phonetics, 19(6), pp.529~544 (2005)
- Principe, C, "Neural and Adaptive Systems: Fundamentals Through Simulations" (2000), Wiley
- Richmond, K, "Estimating articulatory parameters from the Speech Signal", 박사, pp.2001
- Rumelhart, D.E, "Learning internal representations by error propagation, In Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1", pp.318~362 (1986), MIT Press
- Shawker, T. H, "Tongue movement during Speech - a real-time ultrasound evaluation", Journal of Clinical Ultrasound, 12(3), pp.125~133 (1984)
- Stone, M, "Toward a three dimensional model of tongue movement", Journal of Phonetics, 19, pp.308~320 (1991)
- Stone, M, "ASA speech production video", ~ (1993)
- Whalen, D. H, "Predicting midsagittal pharynx shape from tongue position during vowel production", Journal of Speech Language and Hearing Research, 42(3), pp.592~603 (1999)
- Ziskin, C, "The comet tail artifact", Journal of Ultrasound in Medicine, 1, pp.1~7 (1982)