본문 바로가기
KERD
논문KCI 등재

다중 레이블 나이브 베이즈 분류를 위한 새로운 사후확률 추정 방법에 관한 연구

A Novel Posterior Probability Estimation Method for Multi-label Naive Bayes Classification

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

주제분류컴퓨터학

초록

A multi-label classification is to find multiple labels associated with the input pattern. Multi-label classification can be achieved by extending conventional single-label classification. Common extension techniques are known as Binary relevance, Label powerset, and Classifier chains. However, most of the extended multi-label naive bayes classifier has not been able to accurately estimate posterior probabilities because it does not reflect the label dependency. And the remaining extended multi-label naive bayes classifier has a problem that it is unstable to estimate posterior probability according to the label selection order. To estimate posterior probability well, we propose a new posterior probability estimation method that reflects the probability between all labels and labels efficiently. The proposed method reflects the correlation between labels. And we have confirmed through experiments that the extended multi-label naive bayes classifier using the proposed method has higher accuracy then the existing multi-label naive bayes classifiers.

Abstract

A multi-label classification is to find multiple labels associated with the input pattern. Multi-label classification can be achieved by extending conventional single-label classification. Common extension techniques are known as Binary relevance, Label powerset, and Classifier chains. However, most of the extended multi-label naive bayes classifier has not been able to accurately estimate posterior probabilities because it does not reflect the label dependency. And the remaining extended multi-label naive bayes classifier has a problem that it is unstable to estimate posterior probability according to the label selection order. To estimate posterior probability well, we propose a new posterior probability estimation method that reflects the probability between all labels and labels efficiently. The proposed method reflects the correlation between labels. And we have confirmed through experiments that the extended multi-label naive bayes classifier using the proposed method has higher accuracy then the existing multi-label naive bayes classifiers.

참고문헌 (27)

  1. Jaedong Lee, "An approach for multi-label classification by directed acyclic graph with label correlation maximization", Information Sciences, 351, pp.101~114 (2016), Elsevier BV[DOI]
  2. L. Enrique Sucar, "Multi-label classification with Bayesian network-based chain classifiers", Pattern Recognition Letters, 41, pp.14~22 (2014), Elsevier BV[DOI]
  3. Min-Ling Zhang, "ML-KNN: A lazy learning approach to multi-label learning", Pattern Recognition, 40(7), pp.2038~2048 (2007), Elsevier BV[DOI]
  4. Min-Ling Zhang, "Feature selection for multi-label naive Bayes classification", Information Sciences, 179(19), pp.3218~3229 (2009), Elsevier BV[DOI]
  5. Godbole, Shantanu, "Discriminative methods for multi-labeled classification", Pacific-Asia conference on knowledge discovery and data mining, pp.22~30 (2004)
  6. Jesse Read, "Classifier chains for multi-label classification", Machine Learning, 85(3), pp.333~359 (2011), Springer Nature[DOI]
  7. Ueda, Naonori, "Parametric mixture models for multi-labeled text", Advances in neural information processing systems, pp.737~744 (2003)
  8. I. Katakis, "Multilabel Text Classification for Automated Tag Suggestion", 2008 Discovery Challenge (2008)
  9. Douglas Turnbull, "Semantic Annotation and Retrieval of Music and Sound Effects", IEEE Transactions on Audio, Speech, and Language Processing, 16(2), pp.467~476 (2008), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  10. Trohidis, Konstantinos, "Multi-Label Classification of Music into Emotions", ISMIR, 8, pp.325~330 (2008)
  11. Elisseeff, Andre, "A kernel method for multi-labelled classification," Advances in neural information processing systems", Advances in neural information processing systems, pp.681~687 (2002)
  12. Alberto Cano, "LAIM discretization for multi-label data", Information Sciences, 330, pp.370~384 (2016), Elsevier BV[DOI]
  13. Min-Ling Zhang, "A Review on Multi-Label Learning Algorithms", IEEE Transactions on Knowledge and Data Engineering, 26(8), pp.1819~1837 (2014), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  14. Klimt, Bryan, "The enron corpus: A new dataset for email classification research", European Conference on Machine Learning, pp.217~226 (2004)
  15. Matthew R. Boutell, "Learning multi-label scene classification", Pattern Recognition, 37(9), pp.1757~1771 (2004), Elsevier BV[DOI]
  16. Barutcuoglu, Zafer, "Hierarchical multi-label prediction of gene function", Bioinformatics, 22(7), pp.830~836 (2006)[DOI]
  17. Joachims, Thorsten, "Text categorization with support vector machines: Learning with many relevant features", European conference on machine learning, pp.137~142 (1998)
  18. Read, Jesse, "Classifier chains for multi-label classification", Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp.254~269 (2009)
  19. Demsar, Janez, "Statistical comparisons of classifiers over multiple data sets", Journal of Machine learning research, pp.1~30 (2006)
  20. Min-Ling Zhang, "<sc>Lift<", sc>: Multi-Label Learning with Label-Specific Features, 2015, pp.37(1), 107~120[DOI]
  21. S. Diplaris, "Protein Classification with Multiple Algorithms", Proc. 10th Panhellenic Conf. Inf., pp.448~456 (2005)
  22. J. Pestian, "A shared task involving multi-label classification of clinical free text", Proc. Work. BioNLP 2007, pp.97~104 (2007)
  23. A. Srivastava, "Discovering recurring anomalies in text reports regarding complex space systems", Proc. 2005 IEEE Aerospace Conf., pp.3853~3862 (2005)
  24. 백영태, "스토리기반 저작물에서 감정어 분류에 기반한 등장인물의 감정 성향 판단", 한국컴퓨터정보학회논문지, 18(9), pp.131~138 (2013), 한국컴퓨터정보학회
  25. Wang, Tinghuai, "Multi-label propagation for coherent video segmentation and artistic stylization", Image Processing (ICIP), 2010 17th IEEE International Conference on, pp.3005~3008 (2010)
  26. Persing, Isaac, "Modeling thesis clarity in student essays", Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, 1, pp.260~269 (2013)
  27. 박종범, "인공지능 포커게임수행엔진 개발", 한국컴퓨터정보학회논문지, 14(11), pp.41~52 (2009), 한국컴퓨터정보학회

관련 논문AI추천

이 간행물의 다른 논문 (10건)