Prediction Models for Suicide Attempts among Adolescents Using Machine Learning Techniques
2
조회
0
다운로드
5
인용
0
참고문헌
키워드
초록
Objective: Suicide attempts (SAs) in adolescents are difficult to predict although it is a leading cause of death among adolescents. This study aimed to develop and evaluate SA prediction models based on six different machine learning (ML) algorithms for Korean adolescents using data from online surveys. Methods: Data were extracted from the 2011−2018 Korea Youth Risk Behavior Survey (KYRBS), an ongoing annual national survey. The participants comprised 468,482 nationally representative adolescents from 400 middle and 400 high schools, aged 12 to 18. The models were trained using several classic ML methods and then tested on internal and external independent datasets; performance metrics were calculated. Data analysis was performed from March 2020 to June 2020. Results: Among the 468,482 adolescents included in the analysis, 15,012 cases (3.2%) were identified as having made an SA. Three features (suicidal ideation, suicide planning, and grade) were identified as the most important predictors. The performance of the six ML models on the internal testing dataset was good, with both the area under the receiver operating characteristic curve (AUROC) and area under the precision−recall curve (AUPRC) ranging from 0.92 to 0.94. Although the AUROC of all models on the external testing dataset (2018 KYRBS) ranged from 0.93 to 0.95, the AUPRC of the models was approximately 0.5. Conclusion: The developed and validated SA prediction models can be applied to detect high risks of SA. This approach could facilitate early intervention in the suicide crisis and may ultimately contribute to suicide prevention for adolescents.
Abstract
Objective: Suicide attempts (SAs) in adolescents are difficult to predict although it is a leading cause of death among adolescents. This study aimed to develop and evaluate SA prediction models based on six different machine learning (ML) algorithms for Korean adolescents using data from online surveys. Methods: Data were extracted from the 2011−2018 Korea Youth Risk Behavior Survey (KYRBS), an ongoing annual national survey. The participants comprised 468,482 nationally representative adolescents from 400 middle and 400 high schools, aged 12 to 18. The models were trained using several classic ML methods and then tested on internal and external independent datasets; performance metrics were calculated. Data analysis was performed from March 2020 to June 2020. Results: Among the 468,482 adolescents included in the analysis, 15,012 cases (3.2%) were identified as having made an SA. Three features (suicidal ideation, suicide planning, and grade) were identified as the most important predictors. The performance of the six ML models on the internal testing dataset was good, with both the area under the receiver operating characteristic curve (AUROC) and area under the precision−recall curve (AUPRC) ranging from 0.92 to 0.94. Although the AUROC of all models on the external testing dataset (2018 KYRBS) ranged from 0.93 to 0.95, the AUPRC of the models was approximately 0.5. Conclusion: The developed and validated SA prediction models can be applied to detect high risks of SA. This approach could facilitate early intervention in the suicide crisis and may ultimately contribute to suicide prevention for adolescents.
참고문헌 (52)
- "Preventing suicide: a global imperative" (2014)[URL]
- "Web-based injury statistics query and reporting system" (2017)[URL]
- Miché M, "Prospective prediction of suicide attempts in community adolescents and young adults, using regression methods and machine learning", J Affect Disord, 265, pp.570~578 (2020)
- "2019 Statistics on the youth" (2019)[URL]
- "Youth risk behavior survey data summary & trends report 2007-2017" (2018)[URL]
- "The 15th Korea youth risk behavior survey" (2019)[URL]
- Carlton PA, "Impact of attitudes and suicidal ideation on adolescents’ intentions to seek professional psychological help", J Adolesc, 23, pp.35~45 (2000)
- Roh S, "Mental health services and R&D in South Korea", Int J Ment Health Syst, 10, pp.45~ (2016)
- "Prevalence and risk factors of psychiatric disorders in child and adolescent populationschool based research"[URL]
- Franklin JC, "Risk factors for suicidal thoughts and behaviors : a meta-analysis of 50 years of research", Psychol Bull, 143, pp.187~232 (2017)
- McArdle JJ, "Contemporary issues in exploratory data mining in the behavioral sciences" (2013), Taylor & Francis
- Burke TA, "The use of machine learning in the study of suicidal and non-suicidal self-injurious thoughts and behaviors : a systematic review", J Affect Disord, 245, pp.869~884 (2019)
- Kessler RC, "Suicide prediction models : a critical review of recent research with recommendations for the way forward", Mol Psychiatry, 25, pp.168~179 (2020)
- Hill RM, "Using machine learning to identify suicide risk : a classification tree approach to prospectively identify adolescent suicide attempters", Arch Suicide Res, 24, pp.218~235 (2020)
- Bae SM, "Prediction by data mining, of suicide attempts in Korean adolescents : a national study", Neuropsychiatr Dis Treat, 11, pp.2367~2375 (2015)
- Carson NJ, "Identification of suicidal behavior among psychiatrically hospitalized adolescents using natural language processing and machine learning of electronic health records", PLoS One, 14, pp.e0211116~ (2019)
- Walsh CG, "Predicting suicide attempts in adolescents with longitudinal clinical data and machine learning", J Child Psychol Psychiatry, 59, pp.1261~1270 (2018)
- Kim Y, "Data resource profile : the Korea youth risk behavior web-based survey(KYRBS)", Int J Epidemiol, 45, pp.1076~1076 (2016)
- "Korea youth risk behavior web-based survey"[URL]
- Husky MM, "Twelve-month suicidal symptoms and use of services among adolescents : results from the National Comorbidity Survey", Psychiatr Serv, 63, pp.989~996 (2012)
- Nock MK, "Prevalence, correlates, and treatment of lifetime suicidal behavior among adolescents : results from the National Comorbidity Survey Replication Adolescent Supplement", JAMA Psychiatry, 70, pp.300~310 (2013)
- Passos IC, "Identifying a clinical signature of suicidality among patients with mood disorders : a pilot study using a machine learning approach", J Affect Disord, 193, pp.109~116 (2016)
- Kursa MB, "Feature selection with the Boruta package", J Stat Softw, 36, pp.1~13 (2010)
- Šimundić AM, "Measures of diagnostic accuracy : basic definitions", EJIFCC, 19, pp.203~211 (2009)
- Hettige NC, "Classification of suicide attempters in schizophrenia using sociocultural and clinical features : a machine learning approach", Gen Hosp Psychiatry, 47, pp.20~28 (2017)
- Mann JJ, "Classification trees distinguish suicide attempters in major psychiatric disorders : a model of clinical decision making", J Clin Psychiatry, 69, pp.23~31 (2008)
- Simon GE, "Predicting suicide attempts and suicide deaths following outpatient visits using electronic health records", Am J Psychiatry, 175, pp.951~960 (2018)
- Walsh CG, "Predicting risk of suicide attempts over time through machine learning", Clin Psychol Sci, 5, pp.457~469 (2017)
- Svensson T, "The association between complete and partial non-response to psychosocial questions and suicide : the JPHC Study", Eur J Public Health, 25, pp.424~430 (2015)
- Mars B, "Using data linkage to investigate inconsistent reporting of self-harm and questionnaire non-response", Arch Suicide Res, 20, pp.113~141 (2016)
- Evans E, "The prevalence of suicidal phenomena in adolescents : a systematic review of population-based studies", Suicide Life Threat Behav, 35, pp.239~250 (2005)
- Turner CF, "Adolescent sexual behavior, drug use, and violence : increased reporting with computer survey technology", Science, 280, pp.867~873 (1998)
- Greist JH, "A computer interview for suicide-risk prediction", Am J Psychiatry, 130, pp.1327~1332 (1973)
- Levine S, "Assessment of suicide risk by computer-delivered self-rating questionnaire : preliminary findings", Acta Psychiatr Scand, 80, pp.216~220 (1989)
- Christl B, "The accuracy of prevalence estimations for suicide attempts. how reliably do adolescents and young adults report their suicide attempts?", Arch Suicide Res, 10, pp.253~263 (2006)
- 양찬모, "청소년기 치료받지 못한 우울증이 젊은 성인 남성의 자살 위험성 및 자살 시도에 미치는 영향", 정신신체의학, 28(1), pp.29~35 (2020), 한국정신신체의학회
- Voss C, "Prevalence, onset, and course of suicidal behavior among adolescents and young adults in Germany", JAMA Netw Open, 2, pp.e1914386~ (2019)
- Mostafizur Rahman M, "Addressing the class imbalance problem in medical datasets", Int J Mach Learn Comput, 3, pp.224~228 (2013)
- Johnson JM, "Survey on deep learning with class imbalance", J Big Data, 6, pp.27~ (2019)
- Chawla NV, "SMOTE : Synthetic minority over-sampling technique", J Artif Intell Res, 16, pp.321~357 (2002)
- Saito T, "The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets", PLoS One, 10, pp.e0118432~ (2015)
- Esteva A, "A guide to deep learning in healthcare", Nat Med, 25, pp.24~29 (2019)
- Kruse CS, "The use of electronic health records to support population health : a systematic review of the literature", J Med Syst, 42, pp.214~ (2018)
- Abadi M, "TensorFlow: a system for large-scale machine learning", Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation, pp.265~283 (2016)
- "Keras" (2015)[URL]
- "cuDNN: efficient primitives for deep learning" (2014)[URL]
- Rudin C, "Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead", Nat Mach Intell, 1, pp.206~215 (2019)
- Wang S, "Training deep neural networks on imbalanced data sets", 2016International Joint Conference on Neural Networks (IJCNN) (2016)
- Khan SH, "Cost-sensitive learning of deep feature representations from imbalanced data", IEEE Trans Neural Netw Learn Syst, 29, pp.3573~3587 (2018)
- Sejnowski TJ, "The unreasonable effectiveness of deep learning in artificial intelligence", Proc Natl Acad Sci U S A, 117, pp.30033~30038 (2020)
- Ritter PL, "Self-reports of health care utilization compared to provider records", J Clin Epidemiol, 54, pp.136~141 (2001)
- "Statistics on adolescents outside school in Korea" (2019)[URL]