KNN 기반의 AI 수화 번역 애플리케이션
KNN-based AI Sign Language Translation Application
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
본 논문에서는 농인들의 일상 소통을 개선하고 비장애인들의 수화 교육을 위해 AI를 활용하여 수화 통역과 교육을 할 수 있는 수화 번역 프로그램을 개발한다. 기존의 수화 언어는 한국어와 동등한 언어로 인정되었지만, 수화 통역 및 교육은 여전히 부족한 상황이다. 농인들은 일상 소통에서 언어적인 격차와 문화적인 어려움을 경험하며, 특히 일반 학교에서 수업을 받는 농인들은 어려움을 겪고 있다. 수화 번역 프로그램은 미디어파이프, OpenCV와 같은 AI 기술을 활용하여 손 동작을 인식하여 수화로 번역한다. 손 동작은 KNN을 사용하여 분석되어 수화를 인식하고 수화 교육 플랫폼 및 의사소통 도구로 활용된다. 이 연구는 농인들의 일상생활의 불편함을 최소화하고 의사소통과 사회적 참여를 촉진하며, 수화 교육의 접근성을 높이는 데 기여할 것으로 기대된다
Abstract
In this paper, we develop a sign language translation program that can use AI for sign language interpretation and education to improve daily communication among farmers and to educate non-disabled people about sign language. Although the existing sign language has been recognized as an equivalent language to Korean, sign language interpretation and education is still lacking. Farmers experience linguistic gaps and cultural challenges in their daily communication, especially those who are educated in mainstream schools. The sign language translation program utilizes AI technologies such as MediaPipe and OpenCV to recognize hand gestures and translate them into sign language. The hand gestures are analyzed using KNN to recognize sign language and used as a sign language education platform and communication tool. This research is expected to contribute to minimizing the inconvenience of farmers' daily life, facilitating communication and social participation, and increasing the accessibility of sign language education. Translated with DeepL.com (free version)
참고문헌 (15)
- S. H. Jung., "Analyzing the Status of Domestic Sing Language-Related Application", The Study of Education for Hearing-Language Impairments, 8(2), pp.93~109 (2017)[DOI]
- E. J. Lee, "Development of the meaning structure of cognitive and psychological verbs of hearing-impaired parents and hearing-impaired children using sign language", Discourse and Cognition, 18(2), pp.89~111 (2011)[DOI]
- I. K. Koh, "Comparative Analysis of Name Signs between Deaf People and Hearing People", The Journal of Special Children Education, 23(2), pp.77~100 (2021)[DOI]
- J. Y. Kim, "Development of a sign language learning assistance system using mediapipe for sign language education of deaf-mutility", The Journal of the Korea Institute of electronic communication sciences, 16(6), pp.1355~1362 (2021)[DOI]
- S. M. Cho, "Developing a mobile application serving sign-language to text translation for the deaf", Proceedings of the Korea Information Processing Society Conference, pp.1012~1015 (2021), Korea Information Processing Society
- S. K. Choi., "The Developmental Model on Bilingual Approach to Improve Literacy for the Hearing Impaired Children in korea", Journal of Special Education, 14(1), pp.111~142 (2007)[DOI]
- T. I. Kang, "Analyzing the The Proficiency of Sign Language, Teaching and Learning Methods, and Structural Relationships of the Proximal Development Zone Recognized by Teachers in Schools for the Hearing Impairment", The Study of Education for Hearing-Language Impairments, 14(3), pp.1~23 (2023)[DOI]
- K.-M. Kim, "Sign Language Translation System Development Using MediaPipe", Proceedings of the Korea Information Processing Society Conference, pp.684~686 (2022), Korea Information Processing Society
- Y. U. Kim, "Multimodal Deep Learning Model for Human Activity Recognition Using Body Landmarks from MediaPipe Extraction and IMU", The Journal of Korean Institute of Next Generation Computing, 20(3), pp.12~21 (2024)[DOI]
- H. Park, "A Study on Eyetracking Cursor Control based-on Opencv", Proceedings of the Korea Information Processing Society Conference, pp.664~665 (2019)
- Y. J. Yang, "An Object Tracking Method for Studio Cameras by OpenCV-based Python Program", The Journal of the Convergence on Culture Technology, 4(1), pp.291~297 (2018)[DOI]
- J. E. Kim., "A Study on the Automatic Recognition of AI-based Port Documents Using OCR-Based on the application of KNN algorithm", Proceedings of the Korea Information Processing Society Conference, pp.872~875 (2019), Korea Information Processing Society
- Y. H. Oh., "Professional Baseball Nomination Prediction Method for High School Baseball Players Using KNN(K-Nearest Neighbors)Classification Algorithm", Journal of Knowledge Information Technology and Systems, 19(3), pp.487~496 (2024)[DOI]
- M. Kim, "Development of Automatic Sign Language Translation System using Korean WordNet", Proceedings of the Korea Information Processing Society Conference, pp.1358~1361 (2013), Korea Information Processing Society
- S. M. Cho, "Developing a mobile application serving sign-language to text translation for the deaf", Proceedings of the Korea Information Processing Society Conference, pp.1012~1015 (2021), Korea Information Processing Society