A New Strategy for Evaluating the Quality of Laboratory Results for Big Data Research: Using External Quality Assessment Survey Data (2010–2020)
1
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
Background: To ensure valid results of big data research in the medical field, the input laboratory results need to be of high quality. We aimed to establish a strategy for evaluating the quality of laboratory results suitable for big data research. Methods: We used Korean Association of External Quality Assessment Service (KEQAS) data to retrospectively review multicenter data. Seven measurands were analyzed using commutable materials: HbA1c, creatinine (Cr), total cholesterol (TC), triglyceride (TG), alpha-fetoprotein (AFP), prostate-specific antigen (PSA), and cardiac troponin I (cTnI). These were classified into three groups based on their standardization or harmonization status. HbA1c, Cr, TC, TG, and AFP were analyzed with respect to peer group values. PSA and cTnI were analyzed in separate peer groups according to the calibrator type and manufacturer, respectively. The acceptance rate and absolute percentage bias at the medical decision level were calculated based on biological variation criteria. Results: The acceptance rate (22.5%–100%) varied greatly among the test items, and the mean percentage biases were 0.6%–5.6%, 1.0%–9.6%, and 1.6%–11.3% for all items that satisfied optimum, desirable, and minimum criteria, respectively. Conclusions: The acceptance rate of participants and their external quality assessment (EQA) results exhibited statistically significant differences according to the quality grade for each criterion. Even when they passed the EQA standards, the test results did not guarantee the quality requirements for big data. We suggest that the KEQAS classification can serve as a guide for building big data.
Abstract
Background: To ensure valid results of big data research in the medical field, the input laboratory results need to be of high quality. We aimed to establish a strategy for evaluating the quality of laboratory results suitable for big data research. Methods: We used Korean Association of External Quality Assessment Service (KEQAS) data to retrospectively review multicenter data. Seven measurands were analyzed using commutable materials: HbA1c, creatinine (Cr), total cholesterol (TC), triglyceride (TG), alpha-fetoprotein (AFP), prostate-specific antigen (PSA), and cardiac troponin I (cTnI). These were classified into three groups based on their standardization or harmonization status. HbA1c, Cr, TC, TG, and AFP were analyzed with respect to peer group values. PSA and cTnI were analyzed in separate peer groups according to the calibrator type and manufacturer, respectively. The acceptance rate and absolute percentage bias at the medical decision level were calculated based on biological variation criteria. Results: The acceptance rate (22.5%–100%) varied greatly among the test items, and the mean percentage biases were 0.6%–5.6%, 1.0%–9.6%, and 1.6%–11.3% for all items that satisfied optimum, desirable, and minimum criteria, respectively. Conclusions: The acceptance rate of participants and their external quality assessment (EQA) results exhibited statistically significant differences according to the quality grade for each criterion. Even when they passed the EQA standards, the test results did not guarantee the quality requirements for big data. We suggest that the KEQAS classification can serve as a guide for building big data.
참고문헌 (40)
- Wang L, "Big data analytics in medical engineering and healthcare: methods, advances and challenges", J Med Eng Technol, 44, pp.267~283 (2020)
- Rumsfeld JS, "Big data analytics to improve cardiovascular care : promise and challenges", Nat Rev Cardiol, 13, pp.350~359 (2016)
- Hong L, "Big data in health care : applications and challenges", Data Inf Manag, 2, pp.175~197 (2018)
- Mashoufi M, "A review of data quality assessment in emergency medical services", Open Med Inform J, 12, pp.19~32 (2018)
- Hallworth MJ, "The ‘70% claim’ : what is the evidence base?", Ann Clin Biochem, 48, pp.487~488 (2011)
- "Division of Laboratory Systems (DLS), Centers for Disease Control and Prevention"[URL]
- Kim Sollip, "Schemes and Performance Evaluation Criteria of Korean Association of External Quality Assessment (KEQAS) for Improving Laboratory Testing", Annals of Laboratory Medicine, 41(2), pp.230~239 (2021), 대한진단검사의학회[DOI]
- John WG, "HbA1c standardisation: history, science and politics", Clin Biochem Rev, 28, pp.163~168 (2007)
- Nakamura M, "Total cholesterol performance of Abell-Levy-Brodie-Kendall reference measurement procedure : certification of Japanese in-vitro diagnostic assay manufacturers through CDC’s cholesterol Reference Method Laboratory Network", Clin Chim Acta, 445, pp.127~132 (2015)
- Nakamura M, "Comparison between the triglycerides standardization of routine methods used in Japan and the chromotropic acid reference measurement procedure used by the CDC Lipid Standardization Programme", Ann Clin Biochem, 53, pp.632~639 (2016)
- Myers GL, "Standardization of serum creatinine measurement : theory and practice", Scand J Clin Lab Invest Suppl, 241, pp.57~63 (2008)
- Kim Sollip, "Proposed Model for Evaluating Real-world Laboratory Results for Big Data Research", Annals of Laboratory Medicine, 43(1), pp.104~107 (2023), 대한진단검사의학회[DOI]
- Jeong-Ho Kim, "Report of Korean Association of External Quality Assessment Service on the Accuracy-Based Lipid Proficiency Testing (2016-2018)", Laboratory Medicine and Quality Assurance, 41(3), pp.121~129 (2019), 대한진단검사정도관리협회[DOI]
- Ferraro S, "Serum α-fetoprotein in pediatric oncology : not a children’s tale", Clin Chem Lab Med, 57, pp.783~797 (2019)
- Ferraro S, "Verification of harmonization of serum total and free prostate-specific antigen(PSA)measurements and implications for medical decisions", Clin Chem, 67, pp.543~553 (2021)
- American Diabetes Association 6, "Glycemic targets : standards of medical care in Diabetes-2021", Diabetes Care, 44, pp.S73~84 (2021)
- Park EY, "Where are cut-off values of serum creatinine in the setting of chronic kidney disease?", Kidney Int, 77, pp.645~646 (2010)
- Grundy SM, "Implications of recent clinical trials for the National Cholesterol Education Program Adult Treatment Panel III guidelines", Circulation, 110, pp.227~239 (2004)
- Gambarin-Gelwan M, "Sensitivity of commonly available screening tests in detecting hepatocellular carcinoma in cirrhotic patients undergoing liver transplantation", Am J Gastroenterol, 95, pp.1535~1538 (2000)
- Trevisani F, "Serum alpha-fetoprotein for diagnosis of hepatocellular carcinoma in patients with chronic liver disease : influence of HBsAg and anti-HCV status", J Hepatol, 34, pp.570~575 (2001)
- Carter HB, "Early detection of prostate cancer : AUA Guideline", J Urol, 190, pp.419~426 (2013)
- "Contemporary cardiac troponin I and T assay analytical characteristics designated by manufacturer IFCC committee on clinical applications of cardiac bio-markers (C-CB) v052022"[URL]
- "The EFLM Biological Variation Database"[URL]
- Weykamp CW, "The analytical goals for hemoglobin A(1c)measurement in IFCC units and National Glycohemoglobin Standardization Program Units are different", Clin Chem, 57, pp.1204~1206 (2011)
- Myers GL, "Recommendations for improving serum creatinine measurement : a report from the Laboratory Working Group of the National Kidney Disease Education Program", Clin Chem, 52, pp.5~18 (2006)
- Warnick GR, "Standardization of measurements for cholesterol, triglycerides, and major lipoproteins", Lab Med, 39, pp.481~490 (2008)
- Hripcsak G, "Bias associated with mining electronic health records", J Biomed Discov Collab, 6, pp.48~52 (2011)
- Weiskopf NG, "Defining and measuring completeness of electronic health records for secondary use", J Biomed Inform, 46, pp.830~836 (2013)
- Marcovina SM, "Biological variability of cholesterol, triglyceride, low- and high-density lipoprotein cholesterol, lipoprotein(a), and apolipoproteins A-I and B", Clin Chem, 40, pp.574~578 (1994)
- Vignati G, "Standardization of PSA measures : a reappraisal and an experience with WHO calibration of Beckman Coulter Access Hybritech total and free PSA", Int J Biol Markers, 22, pp.295~301 (2007)
- Stephan C, "20-25% lower concentrations of total and free prostate-specific antigen(PSA)after calibration of PSA assays to the WHO reference materials—analysis of 1098 patients in four centers", Int J Biol Markers, 24, pp.65~69 (2009)
- Marques-Garcia F, "Critical review and meta-analysis of biological variation estimates for tumor markers", Clin Chem Lab Med, 60, pp.494~504 (2022)
- Carobene A, "Biological variation estimates for prostate specific antigen from the European Biological Variation Study; consequences for diagnosis and monitoring of prostate cancer", Clin Chim Acta, 486, pp.185~191 (2018)
- Christenson RH, "Comparison of 13 commercially available cardiac troponin assays in a multicenter North American study", J Appl Lab Med, 2, pp.134~ (2017)
- 김헌성, "Medical Big Data Is Not Yet Available - Why We Need Realism Rather Than Exaggeration", Endocrinology and Metabolism, 34(4), pp.349~354 (2019), 대한내분비학회[DOI]
- Dash S, "Big data in healthcare: management, analysis and future prospects", J Big Data, 6, pp.54~ (2019)
- Shi X, "An automated data cleaning method for electronic health records by incorporating clinical knowledge", BMC Med Inform Decis Mak, 21, pp.267~ (2021)
- Vesper HW, "Current practices and challenges in the standardization and harmonization of clinical laboratory tests", Am J Clin Nutr, 104(Suppl 3), pp.907S~912S (2016)
- Panteghini M, "Implementation of standardization in clinical practice : not always an easy task", Clin Chem Lab Med, 50, pp.1237~1241 (2012)