Reliability and Validity of a Tablet-Based Neuropsychological Test (the Hellocog) for Screening Dementia
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Objective To address the gap in timely diagnosis of dementia due to limited screening tools, we investigated the validity and reliability of the Hellocog, computerized neuropsychological test based on tablets for screening dementia. The higher the probability score on the Hellocog, the higher the likelihood of dementia.Methods This study included 100 patients with dementia and 100 individuals with normal cognition who were aged 60 years or older and free of other major psychiatric, neurological, or medical conditions. They administered the Hellocog on a tablet under the supervision of a neuropsychologist. To determine test-retest reliability, 20 took the Hellocog again after 4 weeks. Diagnostic performance was assessed using the receiver operator characteristics (ROC) analysis.Results The Hellocog showed adequate internal consistency (Cronbach’s alpha=0.69) and good test-retest reliability (intraclass correlation coefficient=0.86, p<0.001). Participants with dementia scored higher on the Hellocog than those with normal cognition (p<0.001), confirming its high criterion validity. Strong correlations with the Mini-Mental Status Examination (MMSE) score and the total score of the Consortium to Establish a Registry for Alzheimer’s Disease Neuropsychological Assessment Battery (CERAD-TS) highlight the concurrent validity of the Hellocog. The area under the ROC curve for dementia of the Hellocog was excellent (0.971) and comparable to that of the MMSE and CERAD-TS. The sensitivity and specificity for dementia were 0.945 and 0.872%, respectively, which were slightly better than those of the MMSE and CERAD-TS.Conclusion Hellocog stands out as a valid and reliable tool for self-administered dementia screening, with promise for improving early detection of dementia.
Abstract
Objective To address the gap in timely diagnosis of dementia due to limited screening tools, we investigated the validity and reliability of the Hellocog, computerized neuropsychological test based on tablets for screening dementia. The higher the probability score on the Hellocog, the higher the likelihood of dementia.Methods This study included 100 patients with dementia and 100 individuals with normal cognition who were aged 60 years or older and free of other major psychiatric, neurological, or medical conditions. They administered the Hellocog on a tablet under the supervision of a neuropsychologist. To determine test-retest reliability, 20 took the Hellocog again after 4 weeks. Diagnostic performance was assessed using the receiver operator characteristics (ROC) analysis.Results The Hellocog showed adequate internal consistency (Cronbach’s alpha=0.69) and good test-retest reliability (intraclass correlation coefficient=0.86, p<0.001). Participants with dementia scored higher on the Hellocog than those with normal cognition (p<0.001), confirming its high criterion validity. Strong correlations with the Mini-Mental Status Examination (MMSE) score and the total score of the Consortium to Establish a Registry for Alzheimer’s Disease Neuropsychological Assessment Battery (CERAD-TS) highlight the concurrent validity of the Hellocog. The area under the ROC curve for dementia of the Hellocog was excellent (0.971) and comparable to that of the MMSE and CERAD-TS. The sensitivity and specificity for dementia were 0.945 and 0.872%, respectively, which were slightly better than those of the MMSE and CERAD-TS.Conclusion Hellocog stands out as a valid and reliable tool for self-administered dementia screening, with promise for improving early detection of dementia.
참고문헌 (44)
- Scheltens P, "Alzheimer's disease", Lancet, 397, pp.1577~1590 (2021)
- Kim KW, "A nation wide survey on the prevalence of dementia and mild cognitive impair ment in South Korea", J Alzheimers Dis, 23, pp.281~291 (2011)
- Suh SW, "A 9-year comparison of dementia prevalence in Korea : results of NaSDEK 2008and 2017", J Alzheimers Dis, 81, pp.821~831 (2021)
- Cummings J, "Anti-amyloid monoclonal antibodies for the treatment of Alzheimer's disease", Bio Drugs, 38, pp.5~22 (2024)
- Amjad H, "Underdiagnosis of dementia : an observational study of patterns in di agnosis and awareness in US older adults", J Gen Intern Med, 33, pp.1131~1138 (2018)
- Thoits T, "Association between dementia severity and recommended lifestyle changes : a retrospective cohort study", Am J Alzheimers Dis Other De men, 33, pp.242~246 (2018)
- Mansfield E, "Optimising diagnosis and post-diagnostic support for people living with dementia : geriatricians' views", BMC Geriatr, 22, pp.143~ (2022)
- Frost R, "Imple menting post diagnostic dementia care in primary care : a mixed-meth ods systematic review", Aging Ment Health, 25, pp.1381~1394 (2021)
- Bradford A, "Missed and de layed diagnosis of dementia in primary care : prevalence and contrib uting factors", Alzheimer Dis Assoc Disord, 23, pp.306~314 (2009)
- Dubois B, "Timely di agnosis for Alzheimer’s disease : a literature review on benefits and chal lenges", J Alzheimers Dis, 49, pp.617~631 (2016)
- Folstein MF, ""Mini-mental state". A practical method for grading the cognitive state of patients for the clinician", J Psychiatr Res, 12, pp.189~198 (1975)
- Kim KW, "Diagnostic accuracy of mini-mental status examination and revised Hasegawa dementia scale for Alzheimer’s disease", Dement Geriatr Cogn Disord, 19, pp.324~330 (2005)
- Larner AJ, "Cognitive screening instruments for dementia : comparing metrics of test limitation", Dement Neuropsychol, 15, pp.458~463 (2021)
- Choi HS, "Deep learn ing based low-cost high-accuracy diagnostic framework for dementia using comprehensive neuropsychological assessment profiles", BMC Geriatr, 18, pp.234~ (2018)
- Lee JH, "Develop ment of the Korean version of the consortium to establish a registry for Alzheimer’s disease assessment packet(CERAD-K) : clinical and neuropsychological assessment batteries", J Gerontol B Psychol Sci Soc Sci, 57, pp.P47~P53 (2002)
- Seo EH, "Total scores of the CERAD neuropsychological assessment battery : validation for mild cognitive impairment and dementia patients with diverse etiologies", Am J Geriatr Psychiatry, 18, pp.801~809 (2010)
- Han JW, "Overview of the Korean longitudinal study on cognitive aging and dementia", Psychiatry Investig, 15, pp.767~774 (2018)
- Yoo SW, "Va lidity of Korean version of the mini-international neuropsychiatric in terview", Anxiety Mood, 2, pp.50~55 (2006)
- Youn JC, "Develop ment of the subjective memory complaints questionnaire", Dement Geriatr Cogn Disord, 27, pp.310~317 (2009)
- Kim JY, "Standardization of the Korean version of the geriatric depression scale : reliability, valid ity, and factor structure", Psychiatry Investig, 5, pp.232~238 (2008)
- Lee DY, "A normative study of the CERAD neuropsychological assessment battery in the Korean elderly", J Int Neuropsychol Soc, 10, pp.72~81 (2004)
- Choi HJ, "A norma tive study of the digit span in an educationally diverse elderly popula tion", Psychiatry Investig, 11, pp.39~43 (2014)
- Kim TH, "Korean ver sion of frontal assessment battery : psychometric properties and nor mative data", Dement Geriatr Cogn Disord, 29, pp.363~370 (2010)
- Reisberg B, "The global deterioration scale for assessment of primary degenerative dementia", Am J Psychia try, 139, pp.1136~1139 (1982)
- American Psychiatric Association, "Diagnostic and statistical manual of mental disorders" (1994), American Psychiatric Association
- McKhann G, "Clinical diagnosis of Alzheimer’s disease : report of the NINCDS ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease", Neurology, 34, pp.939~944 (1984)
- Roman GC, "Vascular dementia: diagnostic criteria for research studies. Report of the NINDS-AIREN International Workshop", Neu rology, 43, pp.250~260 (1993)
- McKeith IG, "Consensus guidelines for the clinical and pathologic diag nosis of dementia with Lewy bodies(DLB) : report of the Consortium on DLB International Workshop", J Alzheimers Dis, 9, pp.417~423 (2006)
- Neary D, "Frontotemporal lobar degeneration : a consensus on clinical diagnostic criteria", Neurology, 51, pp.1546~1554 (1998)
- Youden WJ, "Index for rating diagnostic tests", Cancer, 3, pp.32~35 (1950)
- DeLong ER, "Comparing the areas under two or more correlated receiver operating characteristic curves : a nonparametric approach", Biometrics, 44, pp.837~845 (1988)
- Berg JL, "Comparing the electronic and standard versions of the Montreal cog nitive assessment in an outpatient memory disorders clinic : a valida tion study", J Alzheimers Dis, 62, pp.93~97 (2018)
- Mielke MM, "Performance of the CogState computerized battery in the Mayo Clinic Study on Aging", Alzheimers Dement, 11, pp.13671376~ (2015)
- Ruggeri K, "Are we there yet? Exploring the impact of translating cognitive tests for dementia using mobile technology in an aging population", Front Aging Neurosci, 8, pp.21~ (2016)
- Scharre DW, "Digi tally translated self-administered gerocognitive examination(eSAGE) : relationship with its validated paper version, neuropsychological eval uations, and clinical assessments", Alzheimers Res Ther, 9, pp.44~ (2017)
- Allard M, "Mobile technologies in the early detection of cognitive decline", PLoS One, 9, pp.e112197~ (2014)
- Lange S, "Measuring slips and lapses when they occur – am bulatory assessment in application to cognitive failures", Conscious Cogn, 24, pp.1~11 (2014)
- Koo BM, "Mobile technology for cognitive assessment of older adults : a scoping review", Innov Aging, 3, pp.igy038~ (2019)
- Thabtah F, "Dementia medical screening using mobile applications : a systematic review with a new mapping model", J Biomed Inform, 111, pp.103573~ (2020)
- American Psychiatric Association, "Diagnostic and statistical manual of mental disorders" (2013), American Psychiatric Association
- Emmady PD, "Major neurocognitive disorder(de mentia)" (2022), StatPearls Publishing
- Levy G, "Mem ory and executive function impairment predict dementia in Parkin son’s disease", Mov Disord, 17, pp.1221~1226 (2002)
- Kansagara D, "A systematic evidence review of the signs and symptoms of dementia and brief cognitive tests available in VA" (2010), Department of Veterans Affairs(US)
- de Vet HCW, "Measurement in medicine : a practical guide" (2011), Cambridge University Press