BERTopic을 활용한 불면증 소셜 데이터 토픽 모델링 및 불면증 경향 문헌 딥러닝 자동분류 모델 구축
Topic Modeling Insomnia Social Media Corpus using BERTopic and Building Automatic Deep Learning Classification Model
0
조회
0
다운로드
19
인용
0
참고문헌
키워드
초록
불면증은 최근 5년 새 환자가 20% 이상 증가하고 있는 현대 사회의 만성적인 질병이다. 수면이 부족할 경우 나타나는 개인 및 사회적 문제가 심각하고 불면증의 유발 요인이 복합적으로 작용하고 있어서 진단 및 치료가 중요한 질환이다. 본 연구는 자유롭게 의견을 표출하는 소셜 미디어 ‘Reddit’의 불면증 커뮤니티인 ‘insomnia’를 대상으로 5,699개의 데이터를 수집하였고 이를 국제수면장애분류 ICSD-3 기준과 정신의학과 전문의의 자문을 받은 가이드라인을 바탕으로 불면증 경향 문헌과 비경향 문헌으로 태깅하여 불면증 말뭉치를 구축하였다. 구축된 불면증 말뭉치를 학습데이터로 하여 5개의 딥러닝 언어모델(BERT, RoBERTa, ALBERT, ELECTRA, XLNet)을 훈련시켰고 성능 평가 결과 RoBERTa가 정확도, 정밀도, 재현율, F1점수에서 가장 높은 성능을 보였다. 불면증 소셜 데이터를 심층적으로 분석하기 위해 기존에 많이 사용되었던 LDA의 약점을 보완하며 새롭게 등장한 BERTopic 방법을 사용하여 토픽 모델링을 진행하였다. 계층적 클러스터링 분석 결과 8개의 주제군(‘부정적 감정’, ‘조언 및 도움과 감사’, ‘불면증 관련 질병’, ‘수면제’, ‘운동 및 식습관’, ‘신체적 특징’, ‘활동적 특징’, ‘환경적 특징’)을 확인할 수 있었다. 이용자들은 불면증 커뮤니티에서 부정 감정을 표현하고 도움과 조언을 구하는 모습을 보였다. 또한, 불면증과 관련된 질병들을 언급하고 수면제 사용에 대한 담론을 나누며 운동 및 식습관에 관한 관심을 표현하고 있었다. 발견된 불면증 관련 특징으로는 호흡, 임신, 심장 등의 신체적 특징과 좀비, 수면 경련, 그로기상태 등의 활동적 특징, 햇빛, 담요, 온도, 낮잠 등의 환경적 특징이 확인되었다.
Abstract
Insomnia is a chronic disease in modern society, with the number of new patients increasing by more than 20% in the last 5 years. Insomnia is a serious disease that requires diagnosis and treatment because the individual and social problems that occur when there is a lack of sleep are serious and the triggers of insomnia are complex. This study collected 5,699 data from ‘insomnia’, a community on ‘Reddit’, a social media that freely expresses opinions. Based on the International Classification of Sleep Disorders ICSD-3 standard and the guidelines with the help of experts, the insomnia corpus was constructed by tagging them as insomnia tendency documents and non-insomnia tendency documents. Five deep learning language models (BERT, RoBERTa, ALBERT, ELECTRA, XLNet) were trained using the constructed insomnia corpus as training data. As a result of performance evaluation, RoBERTa showed the highest performance with an accuracy of 81.33%. In order to in-depth analysis of insomnia social data, topic modeling was performed using the newly emerged BERTopic method by supplementing the weaknesses of LDA, which is widely used in the past. As a result of the analysis, 8 subject groups (‘Negative emotions’, ‘Advice and help and gratitude’, ‘Insomnia-related diseases’, ‘Sleeping pills’, ‘Exercise and eating habits’, ‘Physical characteristics’, ‘Activity characteristics’, ‘Environmental characteristics’) could be confirmed. Users expressed negative emotions and sought help and advice from the Reddit insomnia community. In addition, they mentioned diseases related to insomnia, shared discourse on the use of sleeping pills, and expressed interest in exercise and eating habits. As insomnia-related characteristics, we found physical characteristics such as breathing, pregnancy, and heart, active characteristics such as zombies, hypnic jerk, and groggy, and environmental characteristics such as sunlight, blankets, temperature, and naps.
참고문헌 (30)
- 고영수, "딥러닝 및 토픽모델링 기법을 활용한 소셜 미디어의 자살 경향 문헌 판별 및 분석", 한국비블리아학회지, 32(3), pp.247~264 (2021), 한국비블리아학회[DOI]
- 국민건강보험공단, "2020년 건강보험통계연보", ~ (2020)
- "질환백과 불면증" (2014), 서울아산병원[URL]
- "수면장애, 국가 건강까지 위협한다" (2014)[URL]
- 윤인영, "수면질환의 종류", Hanyang Medical Reviews, 33(4), pp.197~202 (2013), 한양대학교 의과대학[DOI]
- 이수빈, "딥러닝 자동 분류 모델을 위한 공황장애 소셜미디어 코퍼스 구축 및 분석", 정보관리학회지, 38(2), pp.153~172 (2021), 한국정보관리학회[DOI]
- Abuzayed, A., "BERT for arabic topic modeling : an experimental study on BERTopic technique", Procedia Computer Science, 189, pp.191~194 (2021)[DOI]
- "op2vec: Distributed representations of topics. arXiv preprint, arXiv:2008.09470" (2020)[URL]
- Buysse D. J., "Insomnia", The Journal of the American Medical Association, 309(7), pp.706~716 (2013)[DOI]
- Qijin Cheng, "Assessing Suicide Risk and Emotional Distress in Chinese Social Media: A Text Mining and Machine Learning Study", Journal of Medical Internet Research, 19(7), pp.e243~ (2017), JMIR Publications Inc.[DOI]
- "Electra: Pre-training text encoders as discriminators rather than generators. arXiv preprint, arXiv:2003.10555" (2020)[URL]
- "Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint, arXiv:1810.04805" (2018)[URL]
- "Bertopic: Leveraging bert and c-tf-idf to create easily interpretable topics" (2020)[URL]
- "BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv preprint, arXiv:2203.05794" (2022)[URL]
- Guo, C., "Mental health question and answering system based on bert model and knowledge graph technology", Proceedings of the 2nd International Symposium on Artificial Intelligence for Medicine Sciences, pp.472~476 (2021)
- He, Q., "Automated assessment of patients’self-narratives for posttraumatic stress disorder screening using natural language processing and text mining", Assessment, 24(2), pp.157~172 (2017)[DOI]
- Hendry, D., "Topic modeling for customer service chats", 2021 International Conference on Advanced Computer Science and Information Systems, pp.1~6 (2021)
- Sepp Hochreiter, "Long Short-Term Memory", Neural Computation, 9(8), pp.1735~1780 (1997), MIT Press - Journals[DOI]
- Jamison-Powell, S., ""I can't get no sleep"discussing insomnia on twitter", Proceedings of the Sigchi Conference on Human Factors in Computing Systems, pp.1501~1510 (2012)
- "Adam: A method for stochastic optimization. ICLR. 2015. arXiv preprint, arXiv:1412.6980, 9" (2015)[URL]
- Jing Xuan Koh, "How loneliness is talked about in social media during COVID-19 pandemic: Text mining of 4,492 Twitter feeds", Journal of Psychiatric Research, 145, pp.317~324 (2022), Elsevier BV[DOI]
- "Albert: A lite bert for self-supervised learning of language representations. arXiv preprint, arXiv:1909.11942" (2019)[URL]
- "Roberta: A robustly optimized bert pretraining approach. arXiv preprint, arXiv:1907.11692" (2019)[URL]
- Martínez-Castaño, R., "BERT-Based transformers for early detection of mental health illnesses", International Conference of the Cross-Language Evaluation Forum for European Languages, pp.189~200 (2021), Springer
- Nikhil Chandran, A., "EEG-based automated detection of schizophrenia using long short-term memory (LSTM) network", Advances in Machine Learning and Computational Intelligence, 26, pp.229~236 (2021), Springer
- Sateia M. J., "International classification of sleep disorders-third editiond", Chest, 146(5), pp.1387~1394 (2014)[DOI]
- "Tired of topic models? clusters of pretrained word embeddings make for fast and good topics too!. arXiv preprint, arXiv:2004.14914" (2020)[URL]
- Emily Van der Nagel, "Anonymity, pseudonymity, and the agency of online identity: Examining the social practices of r", Gonewild, 2015, pp.20(3), ~[DOI]
- Vaswani, A., "Advances in Neural Information Processing Systems, 30" (2017)
- Yang, Z., "XLNet:Generalized autoregressive pretraining for language understanding", Advances in Neural Information Processing Systems, 32 (2019)