Comparison of Machine Learning Algorithms for Classification of the Sentences in Three Clinical Practice Guidelines
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Objectives: Clinical Practice Guidelines (CPGs) are an effective tool for minimizing the gap between a physician’s clinical decision and medical evidence and for modeling the systematic and standardized pathway used to provide better medical treatment to patients. Methods: In this study, sentences within the clinical guidelines are categorized according to a classification system. We used three clinical guidelines that incorporated knowledge from medical experts in the field of family medicine. These were the seventh report of the Joint National Committee (JNC7) on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure from the National Heart, Lung, and Blood Institute; the third report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults from the same institution; and the Standards of Medical Care in Diabetes 2010 report from the American Diabetes Association. Three annotators each tagged 346 sentences hand-chosen from these three clinical guidelines. The three annotators then carried out cross-validations of the tagged corpus. We also used various machine learning-based classifiers for sentence classification. Results: We conducted experiments using real-valued features and token units, as well as a Boolean feature. The results showed that the combination of maximum entropy-based learning and information gain-based feature extraction gave the best classification performance (over 98% f-measure) in four sentence categories. Conclusions: This result confirmed the contribution of the feature reduction algorithm and optimal technique for very sparse feature spaces, such as the sentence classification problem in the clinical guideline document.
Abstract
Objectives: Clinical Practice Guidelines (CPGs) are an effective tool for minimizing the gap between a physician’s clinical decision and medical evidence and for modeling the systematic and standardized pathway used to provide better medical treatment to patients. Methods: In this study, sentences within the clinical guidelines are categorized according to a classification system. We used three clinical guidelines that incorporated knowledge from medical experts in the field of family medicine. These were the seventh report of the Joint National Committee (JNC7) on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure from the National Heart, Lung, and Blood Institute; the third report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults from the same institution; and the Standards of Medical Care in Diabetes 2010 report from the American Diabetes Association. Three annotators each tagged 346 sentences hand-chosen from these three clinical guidelines. The three annotators then carried out cross-validations of the tagged corpus. We also used various machine learning-based classifiers for sentence classification. Results: We conducted experiments using real-valued features and token units, as well as a Boolean feature. The results showed that the combination of maximum entropy-based learning and information gain-based feature extraction gave the best classification performance (over 98% f-measure) in four sentence categories. Conclusions: This result confirmed the contribution of the feature reduction algorithm and optimal technique for very sparse feature spaces, such as the sentence classification problem in the clinical guideline document.
참고문헌 (26)
- Woolf SH, "Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines", BMJ, 318(7182), pp.527~530 (1999)
- Buchanan BG, "Rule-based expert systems: the MYCIN experiments of the Stanford Heuristic Programming Project" (1984), Addison-Wesley
- Kim SN, "Automatic classification of sentences to support Evidence Based Medicine", BMC Bioinformatics, 12(Suppl 2), pp.S5~ (2011)
- Nawaz R, "Meta- knowledge annotation of bio-events", Proceedings of the International Conference on Language Resources and Evaluation, pp.2498~2505 (2010)
- Pan F, "Multi-dimensional fragment classification in biomedical text", pp.2006
- Duda RO, "Pattern classification" (2000), Wiley
- Heckerman D, "Bayesian networks for data mining", Data Min Knowl Discov, 1(1), pp.79~119 (1997)
- Tan PN, "Introduction to data mining" (2006), Pearson Addison-Wesley
- Cho SB, "Machine learning in DNA microarray analysis for cancer classification", Proceedings of the 1st Asia-Pacific Bioinformatics Conference on Bioinformatics, pp.189~198 (2003)
- Vapnik VN, "Statistical learning theory" (1998), Wiley
- Cristianini N, "An introduction to support vector machines: and other kernel-based learning methods" (2000), Cambridge University Press
- Liu H, "Toward integrating feature selection algorithms for classification and clustering", IEEE Trans Knowl Data Eng, 17(4), pp.491~502 (2005)
- Khan A, "A review of machine learning algorithms for text-documents classification", J Adv Inf Technol, 1(1), pp.4~20 (2010)
- Yang Y, "A comparative study on feature selection in text categorization", Proceedings of the 14th International Conference on Machine Learning, pp.412~420 (1997)
- Lee C, "Information gain and divergence-based feature selection for machine learning-based text categorization", Inf Process Manag, 42(1), pp.155~165 (2006)
- Silla CN Jr, "Automatic text summarization with genetic algorithm-based attribute selection", Advances in Artificial Intelligence, Lecture Notes in Computer Science, 3315, pp.305~314 (2004), Springer
- The seventh report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure, "The National Heart, Lung, and Blood Institute", National Institutes of Health, ~ (2004)
- Third report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (adult treatment panel III), "The National Heart, Lung, and Blood Institute", National Institutes of Health, ~ (2002)
- American Diabetes Association, "Standards of medical care in diabetes: 2010", Diabetes Care, 33(Suppl 1), pp.S11~S61 (2010)
- Shatkay H, "Multi-dimensional classification of biomedical text: toward automated, practical provision of high-utility text to diverse users", Bioinformatics, 24(18), pp.2086~2093 (2008)
- Thompson P, "Categorising modality in biomedical texts", Proceedings of the LREC 2008 Workshop on Building and Evaluating Resources for Biomedical Text Mining, pp.27~34 (2008)
- Feldman R, "The text mining handbook: advanced approaches in analyzing unstructured data" (2007), Cambridge University Press
- "The Stanford parser: a statistical parser" (2012)[URL]
- 송미화, "A Multi-Classifier Based Guideline Sentence Classification System", Healthcare Informatics Research, 17(4), pp.224~231 (2011), 대한의료정보학회
- "Weka3: data mining software in Java" (2012)[URL]
- "Weka sources" (2012)[URL]