Comparison of RCF Scoring System to Clinical Decision for the Rey Complex Figure Using Machine-Learning Algorithm
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Background and Purpose: Interpreting the Rey complex figure (RCF) requires a standard RCF scoring system and clinical decision by clinicians. The interpretation of RCF using clinical decision by clinicians might not be accurate in the diagnosing of mild cognitive impairment (MCI) or dementia patients in comparison with the RCF scoring system. For this reason, a machine-learning algorithm was used to demonstrate that scoring RCF using clinical decision is not as accurate as of the RCF scoring system in predicting MCI or mild dementia patients from normal subjects. Methods: The RCF dataset consisted of 2,232 subjects with formal neuropsychological assessments. The RCF dataset was classified into 2 datasets. The first dataset was to compare normal vs. abnormal and the second dataset was to compare normal vs. MCI vs. mild dementia. Models were trained using a convolutional neural network for machine learning. Receiver operating characteristic curves were used to compare the sensitivity, specificity, and area under the curve (AUC) of models. Results: The trained model's accuracy for predicting cognitive states was 96% with the first dataset (normal vs. abnormal) and 88% with the second dataset (normal vs. MCI vs. mild dementia). The model had a sensitivity of 85% for detecting abnormal with an AUC of 0.847 with the first dataset. It had a sensitivity of 78% for detecting MCI or mild dementia with an AUC of 0.778 with the second dataset. Conclusions: Based on this study, the RCF scoring system has the potential to present more accurate criteria than the clinical decision for distinguishing cognitive impairment among patients.
Abstract
Background and Purpose: Interpreting the Rey complex figure (RCF) requires a standard RCF scoring system and clinical decision by clinicians. The interpretation of RCF using clinical decision by clinicians might not be accurate in the diagnosing of mild cognitive impairment (MCI) or dementia patients in comparison with the RCF scoring system. For this reason, a machine-learning algorithm was used to demonstrate that scoring RCF using clinical decision is not as accurate as of the RCF scoring system in predicting MCI or mild dementia patients from normal subjects. Methods: The RCF dataset consisted of 2,232 subjects with formal neuropsychological assessments. The RCF dataset was classified into 2 datasets. The first dataset was to compare normal vs. abnormal and the second dataset was to compare normal vs. MCI vs. mild dementia. Models were trained using a convolutional neural network for machine learning. Receiver operating characteristic curves were used to compare the sensitivity, specificity, and area under the curve (AUC) of models. Results: The trained model's accuracy for predicting cognitive states was 96% with the first dataset (normal vs. abnormal) and 88% with the second dataset (normal vs. MCI vs. mild dementia). The model had a sensitivity of 85% for detecting abnormal with an AUC of 0.847 with the first dataset. It had a sensitivity of 78% for detecting MCI or mild dementia with an AUC of 0.778 with the second dataset. Conclusions: Based on this study, the RCF scoring system has the potential to present more accurate criteria than the clinical decision for distinguishing cognitive impairment among patients.
참고문헌 (23)
- Harvey PD, "Clinical applications of neuropsychological assessment", Dialogues Clin Neurosci, 14, pp.91~99 (2012)
- Petersen RC, "Mild cognitive impairment: a concept in evolution", J Intern Med, 275, pp.214~228 (2014)
- Duong S, "Dementia: what pharmacists need to know", Can Pharm J (Ott), 150, pp.118~129 (2017)
- Shin MS, "Clinical and empirical applications of the Rey-Osterrieth complex figure test", Nat Protoc, 1, pp.892~899 (2006)
- Corwin J, "Psychological examination of traumatic encephalopathy", Clin Neuropsychol, 7, pp.3~21 (2007)
- Canham R, "Automated scoring of a neuropsychological test: the Rey Osterrieth complex figure", Proceedings of the 26th Euromicro Conference, pp.406~413 (2000), IEEE
- Vogt J, "Automated scoring of the Rey-Osterrieth complex figure test using a deep-learning algorithm", Arch Clin Neuropsychol, 34, pp.836~836 (2019)
- Zhang X, "Overview of the complex figure test and its clinical application in neuropsychiatric disorders, including copying and recall", Front Neurol, 12, pp.680474~ (2021)
- Kim KW, "A comprehensive evaluation of the process of copying a complex figure in early- and late-onset Alzheimer disease: a quantitative analysis of digital pen data", J Med Internet Res, 22, pp.18136~ (2020)
- Morris JC, "The clinical dementia rating (CDR): current version and scoring rules", Neurology, 43, pp.2412~2414 (1993)
- Youn YC, "Detection of cognitive impairment using a machine-learning algorithm", Neuropsychiatr Dis Treat, 14, pp.2939~2945 (2018)
- Ngiam KY, "Big data and machine learning algorithms for health-care delivery", Lancet Oncol, 20, pp.e262~e273 (2019)
- Kang MJ, "Prediction of cognitive impairment via deep learning trained with multi-center neuropsychological test data", BMC Med Inform Decis Mak, 19, pp.231~ (2019)
- Caballé-Cervigón N, "Machine learning applied to diagnosis of human diseases: a systematic review", Appl Sci, 10, pp.5135~ (2020)
- Van HP, "A High-accuracy model average ensemble of convolutional neural networks for classification of cloud image patches on small datasets", Applied Sciences, 9, pp.4500~ (2019)
- Li Y, "Research and Implementation of CNN based on TensorFlow", IOP Conf Series Mater Sci Eng, 490, pp.042022~ (2019)
- Shorten C, "A survey on image data augmentation for deep learning", J Big Data, 6, pp.60~ (2019)
- Carpenter CR, "Four sensitive screening tools to detect cognitive dysfunction in geriatric emergency department patients: brief Alzheimer's Screen, Short Blessed Test, Ottawa 3DY, and the caregiver-completed AD8", Acad Emerg Med, 18, pp.374~384 (2011)
- Kasai M, "Non-verbal learning is impaired in very mild Alzheimer's disease (CDR 0.5): normative data from the learning version of the Rey-Osterrieth complex figure test", Psychiatry Clin Neurosci, 60, pp.139~146 (2006)
- Mikołajczyk A, "Data augmentation for improving deep learning in image classification problem", International Interdisciplinary PhD Workshop (IIPhDW), pp.117~122 (2018), IEEE
- Ketkar N, "Deep Learning with Python", pp.97~111 (2017), Apress
- Grundman M, "Mild cognitive impairment can be distinguished from Alzheimer disease and normal aging for clinical trials", Arch Neurol, 61, pp.59~66 (2014)
- Chang YL, "Global clinical dementia rating of 0.5 in MCI masks variability related to level of function", Neurology, 76, pp.652~659 (2011)