Development of Decision Support Formulas for the Prediction of Bladder Outlet Obstruction and Prostatic Surgery in Patients With Lower Urinary Tract Symptom/Benign Prostatic Hyperplasia: Part II, External Validation and Usability Testing of a Smartphone App
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Purpose: We aimed to externally validate the prediction model we developed for having bladder outlet obstruction (BOO) and requiring prostatic surgery using 2 independent data sets from tertiary referral centers, and also aimed to validate a mobile app for using this model through usability testing. Methods: Formulas and nomograms predicting whether a subject has BOO and needs prostatic surgery were validated with an external validation cohort from Seoul National University Bundang Hospital and Seoul Metropolitan Government-Seoul National University Boramae Medical Center between January 2004 and April 2015. A smartphone-based app was developed, and 8 young urologists were enrolled for usability testing to identify any human factor issues of the app. Results: A total of 642 patients were included in the external validation cohort. No significant differences were found in the baseline characteristics of major parameters between the original (n=1,179) and the external validation cohort, except for the maximal flow rate. Predictions of requiring prostatic surgery in the validation cohort showed a sensitivity of 80.6%, a specificity of 73.2%, a positive predictive value of 49.7%, and a negative predictive value of 92.0%, and area under receiver operating curve of 0.84. The calibration plot indicated that the predictions have good correspondence. The decision curve showed also a high net benefit. Similar evaluation results using the external validation cohort were seen in the predictions of having BOO. Overall results of the usability test demonstrated that the app was user-friendly with no major human factor issues. Conclusions: External validation of these newly developed a prediction model demonstrated a moderate level of discrimination, adequate calibration, and high net benefit gains for predicting both having BOO and requiring prostatic surgery. Also a smartphone app implementing the prediction model was user-friendly with no major human factor issue.
Abstract
Purpose: We aimed to externally validate the prediction model we developed for having bladder outlet obstruction (BOO) and requiring prostatic surgery using 2 independent data sets from tertiary referral centers, and also aimed to validate a mobile app for using this model through usability testing. Methods: Formulas and nomograms predicting whether a subject has BOO and needs prostatic surgery were validated with an external validation cohort from Seoul National University Bundang Hospital and Seoul Metropolitan Government-Seoul National University Boramae Medical Center between January 2004 and April 2015. A smartphone-based app was developed, and 8 young urologists were enrolled for usability testing to identify any human factor issues of the app. Results: A total of 642 patients were included in the external validation cohort. No significant differences were found in the baseline characteristics of major parameters between the original (n=1,179) and the external validation cohort, except for the maximal flow rate. Predictions of requiring prostatic surgery in the validation cohort showed a sensitivity of 80.6%, a specificity of 73.2%, a positive predictive value of 49.7%, and a negative predictive value of 92.0%, and area under receiver operating curve of 0.84. The calibration plot indicated that the predictions have good correspondence. The decision curve showed also a high net benefit. Similar evaluation results using the external validation cohort were seen in the predictions of having BOO. Overall results of the usability test demonstrated that the app was user-friendly with no major human factor issues. Conclusions: External validation of these newly developed a prediction model demonstrated a moderate level of discrimination, adequate calibration, and high net benefit gains for predicting both having BOO and requiring prostatic surgery. Also a smartphone app implementing the prediction model was user-friendly with no major human factor issue.
참고문헌 (16)
- Songzhe Piao, "Holmium Laser Enucleation of the Prostate is Safe for Patients Above 80 Years: A Prospective Study", International Neurourology Journal, 20(2), pp.143~150 (2016), 대한배뇨장애요실금학회
- 김명, "Factors Influencing Nonabsolute Indications for Surgery in Patients With Lower Urinary Tract Symptoms Suggestive of Benign Prostatic Hyperplasia: Analysis Using Causal Bayesian Networks", International Neurourology Journal, 18(4), pp.198~205 (2014), 대한배뇨장애요실금학회
- 전호준, "The effect of posture and repetition on urodynamic parameters: A prospective randomized study", Investigative and Clinical Urology, 58(1), pp.34~41 (2017), 대한비뇨기과학회[DOI]
- 추민수, "Development of Decision Support Formulas for the Prediction of Bladder Outlet Obstruction and Prostatic Surgery in Patients With Lower Urinary Tract Symptom", Benign Prostatic Hyperplasia: Part I, Development of the Formula and its Internal Validation, 2017, pp.21, 55~65[DOI]
- Lindholm B, "External validation of a 3-step falls prediction model in mild Parkinson’s disease", J Neurol, 263, pp.2462~2469 (2016)
- Debray TP, "A new framework to enhance the interpretation of external validation studies of clinical prediction models", J Clin Epidemiol, 68, pp.279~289 (2015)
- Abrams P, "The standardisation of terminology of lower urinary tract function : report from the Standardisation Sub-committee of the International Continence Society", Neurourol Urodyn, 21, pp.167~178 (2002)
- Parikh R, "Understanding and using sensitivity, specificity and predictive values", Indian J Ophthalmol, 56, pp.45~50 (2008)
- Rosier PF, "Is there a correlation between prostate size and bladder-outlet obstruction?", World J Urol, 13, pp.9~13 (1995)
- Chia SJ, "Correlation of intravesical prostatic protrusion with bladder outlet obstruction", BJU Int, 91, pp.371~374 (2003)
- Ku JH, "Correlation between prostatic urethral angle and bladder outlet obstruction index in patients with lower urinary tract symptoms", Urology, 75, pp.1467~1471 (2010)
- Kaplan SA, "Transition zone index as a method of assessing benign prostatic hyperplasia: correlation with symptoms, urine flow and detrusor pressure", J Urol, 154, pp.1764~1769 (1995)
- Vashist SK, "Commercial smartphonebased devices and smart Apps for personalized healthcare monitoring and management", Diagnostics(Basel), 4, pp.104~128 (2014)
- Cruz Zapata B, "Mobile PHRs compliance with Android and iOS usability guidelines", J Med Syst, 38, pp.81~ (2014)
- Wiklund M KJ, "Usability testing of medical devices", pp.37~51 (2016), CRC Press
- Wiklund M, "Usability testing of medical devices", pp.111~134 (2016), CRC Press