본문 바로가기
KERD
논문KCI 등재

Research Trends in the Evaluation and Treatment of Speech Disorders Using Automatic Speech Recognition (ASR)

Ji Youn Kim
한국청각언어재활학회 (Korean Academy of Audiology)|2024.10|Audiology and Speech Research|제20권 제4호|pp. 253-262|DOI https://doi.org/10.21848/asr.240159

1

조회

0

다운로드

0

인용

0

참고문헌

키워드

Literature review문헌 연구말장애자동음성인식 (ASR)Speech disordersAutomatic speech recognition (ASR)

초록

Purpose: The purpose of this study is to examine recent research trends regarding automatic speech recognition (ASR), which is used in the evaluation and intervention of speech disorders. Methods: Through a search engine, articles published in domestic journals were searched. A total of 27 papers were selected from the searched documents and analyzed according to the year, research subject, speech task, and ASR system. Results: The years with the most research was done in 2019~2021. The subjects who most frequently underwent speech evaluation and treatment using ASR system were those with dysarthria. The speech production tasks used to utilize ASR were at the word and sentence level, and commercialized and non-commercialized ASR systems were used similarly. Conclusion: These results might be used for the fundamental data to establish the most suitable evaluation methods and intervention plans for patients with speech disorders in clinical and research fields.

Abstract

Purpose: The purpose of this study is to examine recent research trends regarding automatic speech recognition (ASR), which is used in the evaluation and intervention of speech disorders. Methods: Through a search engine, articles published in domestic journals were searched. A total of 27 papers were selected from the searched documents and analyzed according to the year, research subject, speech task, and ASR system. Results: The years with the most research was done in 2019~2021. The subjects who most frequently underwent speech evaluation and treatment using ASR system were those with dysarthria. The speech production tasks used to utilize ASR were at the word and sentence level, and commercialized and non-commercialized ASR systems were used similarly. Conclusion: These results might be used for the fundamental data to establish the most suitable evaluation methods and intervention plans for patients with speech disorders in clinical and research fields.

참고문헌 (39)

  1. Ahmed, B., "Speech-driven mobile games for speech therapy : User experiences and feasibility", International Journal of Speech-Language Pathology, 20(6), pp.644~658 (2018)
  2. Bae, I. H., "Development of a speech recognition threshold application using voice recognition technology : Pilot study", Journal of Speech-Language and Hearing disorders, 24(4), pp.103~112 (2015)
  3. Ballard, K. J., "Feasibility of automatic speech recognition for providing feedback during tablet-based treatment for apraxia of speech plus aphasia", American Journal of Speech-Language Pathology, 28(2S), pp.818~834 (2019)
  4. Calvo, I., "Evaluation of an automatic speech recognition platform for dysarthric speech", Folia Phoniatrica et Logopaedica, 73(5), pp.432~441 (2021)
  5. De Russis, L., "On the impact of dysarthric speech on contemporary ASR cloud platforms", Journal of Reliable Intelligent Environments, 5, pp.163~172 (2019)
  6. Dimauro, G., "Assessment of speech intelligibility in Parkinson’s disease using a speech-to-text system", IEEE Access, 5, pp.22199~22208 (2017)
  7. Findley, B. R., "Use of speech-to-text biofeedback in intervention for children with articulation disorders", Perspectives of the ASHA Special Interest Groups, 7(3), pp.926~937 (2022)
  8. Gerosa, M., "A Review of ASR Technologies for Children’s Speech", Proceedings of the 2nd Workshop on Child, Computer and Interaction (2009), ICMI-MLMI
  9. Goudarzi, A., "Automatic speech recognition in noise for Parkinson’s disease : A pilot study", Frontiers in Artificial Intelligence, 4, pp.809321~ (2021)
  10. Green, J. R., "Automatic speech recognition of disordered speech : Personalized models outperforming human listeners on short phrases", Interspeech, 2021, pp.4778~4782 (2021)
  11. Gutz, S. E., "Automatic speech recognition as a clinical tool:Implications for speech assessment and intervention", master, pp.2022
  12. Gutz, S. E., "Validity of off-the-shelf automatic speech recognition for assessing speech intelligibility and speech severity in speakers with amyotrophic lateral sclerosis", Journal of Speech, Language, and Hearing Research, 65(6), pp.2128~2143 (2022)
  13. Hwang, Y., "Comparison between Intelligibility and Speech Recognition Accuracy of Dysarthric Speech", Proceedings of the HCI conference (2011)
  14. Jacks, A., "Automated speech recognition in adult stroke survivors: Comparing human and computer transcriptions", Folia Phoniatrica et Logopaedica, 71(5-6), pp.286~296 (2019)
  15. Jaddoh, A., "Interaction between people with dysarthria and speech recognition systems : A review", Assistive Technology, 35(4), pp.330~338 (2023)
  16. "Usability of automatic speech recognition systems for individuals with speech disorders: Past, present, future, and a proposed model" (2019)[URL]
  17. Kennedy, J., "Child speech recognition in humanrobot interaction: Evaluations and recommendations", Proceedings of the 2017 ACM, 2017, pp.2017, 82~90
  18. Kim, A., "A phonological study in the error types of Korean automatic speech recognition", master, pp.2022
  19. Lee, S. H., "Assessment of dysarthria using one-word speech recognition with hidden markov models", Journal of Korean Medical Science, 34(13), pp.e108~ (2019)
  20. Lilley, J., "Automating an Objective Measure of Pediatric Speech Intelligibility", Fifteenth Annual Conference of the International Speech Communication Association (2014), ISCA
  21. Maier, A., "Automatic speech recognition systems for the evaluation of voice and speech disorders in head and neck cancer", EURASIP Journal on Audio, Speech, and Music Processing, 2010, pp.1~7 (2010)
  22. Mengistu, K. T., "Comparing humans and automatic speech recognition systems in recognizing dysarthric speech", Advances in Artificial Intelligence, 24, pp.291~300 (2011)
  23. Moro-Velazquez, L., "Study of the performance of automatic speech recognition systems in speakers with Parkinson’s disease", Interspeech, 9, pp.3875~3879 (2019)
  24. Moya-Galé, G., "Automatic assessment of intelligibility in noise in Parkinson disease: Validation study", Journal of Medical Internet Research, 24(10), pp.e40567~ (2022)
  25. Mun, J., "Deep learning-based speech recognition for Korean elderly speech data including dementia patients", The Korean Journal of Applied Statistics, 36(1), pp.33~48 (2023)
  26. Mustafa, M. B., "Exploring the influence of general and specific factors on the recognition accuracy of an ASR system for dysarthric speaker", Expert Systems with Applications, 42(8), pp.3924~3932 (2015)
  27. Park, H., "The effects of home training for children with speech sound disorders using artificial intelligence speakers", Korean Speech Therapy Association Conference Proceedings, 21, pp.319~322 (2020)
  28. Park, W. J., "Effects of using a communication maintenance strategy in the context of AI speaker and preschoolers’conversation and book reading interaction : Comparison of group differences on the levels of expressive language development", Journal of Speech-Language and Hearing Disorders, 30(2), pp.1~8 (2021)
  29. Rosdi, F., "The effect of changes in speech features on the recognition accuracy of ASR system : A study on the Malay speech impaired children", Malaysian Journal of Computer Science, 30(1), pp.48~62 (2017)
  30. Salim, S. S., "A speech pronunciation practice system for speech-impaired children : A study to measure its success", Research in Developmental Disabilities, 56, pp.41~59 (2016)
  31. Schultz, B. G., "Automatic speech recognition in neurodegenerative disease", International Journal of Speech Technology, 24(3), pp.771~779 (2021)
  32. Schuster, M., "Evaluation of speech intelligibility for children with cleft lip and palate by means of automatic speech recognition", International Journal of Pediatric Otorhinolaryngology, 70(10), pp.1741~1747 (2006)
  33. Son, G., "Enhanced AI model to improve child speech recognition", Journal of Digital Contests Society, 25(2), pp.547~555 (2024)
  34. Tobin, J., "Automatic speech recognition of conversational speech in individuals with disordered speech", Journal of Speech, Language, and Hearing Research, pp.1~10 (2024)
  35. Tomanek, K., "An analysis of degenerating speech due to progressive dysarthria on ASR performance", ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing, pp.1~5 (2023)
  36. Tröger, J., "An automatic measure for speech intelligibility in dysarthrias—validation across multiple languages and neurological disorders", Frontiers in Digital Health, 6, pp.1~10 (2024)
  37. Tu, M., "The relationship between perceptual disturbances in dysarthric speech and automatic speech recognition performance", The Journal of the Acoustical Society of America, 140(5), pp.416~422 (2016)
  38. Vachhani, B., "Data augmentation using healthy speech for dysarthric speech recognition", Interspeech, 5, pp.471~475 (2018)
  39. Yoo, H. J., "Comparative analysis of Korean continuous speech recognition accuracy by application field of cloud-based speech recognition open API", The Journal of Korean of Communications & Information Sciences, 45(10), pp.1793~1803 (2020)

관련 논문AI추천

Research Trends According to the Speech Production Mechanism of Patients with Dysarthria Caused by Acute Brain Injury in KoreaJi Hye Yoon, Mi Ri Park, Young Man Kim한국청각언어재활학회 · Audiology and Speech Research2023 · 제19권 제4호한국인 구음장애 환자의 발화 데이터 기반 질병 예측을 위한 모바일 애플리케이션 개발고태식, 하창진대한의용생체공학회 · 의공학회지2024 · 제45권 제1호언어재활사의 노년층 마비말장애 화자 말명료도 평가와 인공지능 음성인식 시스템의 음성인식 정확도 비교 및 예측성철재, 오영건사단법인 한국언어학회 · 언어학2025 · 제102호음질, 운율, 발음 특징을 이용한 마비말장애 중증도 자동 분류김선희, 여은정, 정민화한국음성학회 · 말소리와 음성과학2021 · 제13권 제2호AI 음성인식 모듈을 통한 말운동 능력 측정 프로그램의 유용성: 예비연구김도형, 김재원, 장대현, 한소라, 한소영한국음성학회 · 말소리와 음성과학2024 · 제16권 제4호말소리장애 아동 발화에 대한 AI 스피커의 음성인식 정확도와 청자의 말명료도 비교김지연, 나예진한국청각언어장애교육학회 · 한국청각언어장애교육연구2025 · 제16권 제2호

이 간행물의 다른 논문 (6건)

Enhancing Mandarin Tone and Vowel Recognition in Cochlear Implant Simulation through Combining Task PracticeSeeon Kim, Qi Gao, Fei Chen, Xin Luopp. 199-207A Study on the Listening Environment in Schools for the Inclusive Education of Students with Hearing ImpairmentsEun-Yeong Shin, Soo Jin Cho, Kyung Ran Parkpp. 208-216A Study on the Rehabilitation Effects of Tinnitus Counseling for Hearing Aid Users Who Suffer from TinnitusDong Uk You, Junghwa Bahngpp. 217-227Selective Word Stress Effect for Speech Perception Enhancement in Hearing-Impaired Older ListenersSunmi Ma, Woojae Hanpp. 228-233Modulation Interference from Speech-Modulated Noise in Bimodal Cochlear Implant UsersJae Ho Han, Jae Hee Lee, Hyo Jung Choipp. 234-241
원문 보기