탐욕적 노드 확장을 통한 계층적 트리의 분류 정확도 향상
Improving Classification Accuracy in Hierarchical Trees via Greedy Node Expansion
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
정보통신 기술이 발전함에 따라 우리는 일상에서 다양한 형태의 데이터를 손쉽게 생성하고 있다. 이처럼 방대한 데이터를 효율적으로 관리하려면, 체계적인 카테고리별 분류가 필수적이다. 효율적인검색과 탐색을 위해서 데이터는 트리 형태의 계층적 구조인 범주 트리로 조직화되는데, 이는 뉴스웹사이트나 위키피디아에서 자주 볼 수 있는 구조이다. 이에 따라 방대한 양의 문서를 범주 트리의단말 노드로 분류하는 다양한 기법들이 제안되었다. 그러나 범주 트리를 대상으로 하는 문서 분류기법들은 범주 트리의 높이가 증가할수록 단말 노드의 수가 기하급수적으로 늘어나고 루트 노드부터단말 노드까지의 길이가 길어져서 오분류 가능성이 증가하며, 결국 분류 정확도의 저하로 이어진다. 그러므로 본 연구에서는 사용자의 요구 분류 정확도를 만족시키면서 세분화된 분류를 구현할 수 있는새로운 노드 확장 기반 분류 알고리즘을 제안한다. 제안 기법은 탐욕적 접근법을 활용하여 높은 분류정확도를 갖는 노드를 우선적으로 확장함으로써, 범주 트리의 분류 정확도를 극대화한다. 실데이터를이용한 실험 결과는 제안 기법이 단순 방법보다 향상된 성능을 제공함을 입증한다.
Abstract
With the advancement of information and communication technology, we can easily generate various forms of data in our daily lives. To efficiently manage such a large amount of data, systematic classification into categories is essential. For effective search and navigation, data is organized into a tree-like hierarchical structure known as a category tree, which is commonly seen in news websites and Wikipedia. As a result, various techniques have been proposed to classify large volumes of documents into the terminal nodes of category trees. However, document classification methods using category trees face a problem: as the height of the tree increases, the number of terminal nodes multiplies exponentially, which increases the probability of misclassification and ultimately leads to a reduction in classification accuracy. Therefore, in this paper, we propose a new node expansion-based classification algorithm that satisfies the classification accuracy required by the application, while enabling detailed categorization. The proposed method uses a greedy approach to prioritize the expansion of nodes with high classification accuracy, thereby maximizing the overall classification accuracy of the category tree. Experimental results on real data show that the proposed technique provides improved performance over naive methods.
참고문헌 (28)
- Z. Lv, "Next-Generation Big Data Analytics: State of the Art, Challenges, and Future Research Topics", IEEE Transactions on Industrial Informatics, 13 (2017)[DOI]
- Z. Yang, "On paradigm of industrial big data analytics:From evolution to revolution", IEEE Transactions on Industrial Informatics, 18 (2022)[DOI]
- J. Wang, "Big data analytics for intelligent manufacturing systems: A review", 62 (2022)[DOI]
- S. Minaee, "Deep Learning-based Text Classification : A Comprehensive Review", ACM Computing Surveys, 54 (2021)[DOI]
- C. Wang, "A Comparative Study on Word Embeddings in Deep Learning for Text Classification", Proceedings of the 4th International Conference on Natural Language Processing and Information Retrieval (2020)
- Q. Li, "A Survey on Text Classification: From Traditional to Deep Learning", ACM Transactions on Intelligent Systems and Technology, 13 (2022)[DOI]
- S. Daud, "Topic Classification of Online News Articles Using Optimized Machine Learning Models", Computers, 12 (2022)[DOI]
- J Andersen, "Why Do We Need Domain-Experts for End-to-End Text Classification? An Overview", Proceedings of the 15th International Conference on Agents and Artificial Intelligence (2023)
- K. M. Almunirawi, "A Comparative Study on Serial Decision Tree Classification Algorithms in Text Mining", International Journal of Intelligent Computing Research, 7 (2016)[DOI]
- S. Wang, "Adapting naive Bayes tree for text classification", Knowledge and Information Systems, 44 (2015)[DOI]
- J. Cervantes, "A comprehensive survey on support vector machine classification: Applications, challenges and trends", Neurocomputing, 408 (2020)[DOI]
- K. Li, "Multi-class text categorization based on LDA and SVM", Procedia Engineering, 15 (2011)[DOI]
- R. Johnson, "Deep pyramid convolutional neural networks for text categorization", Proceedings of the Annual Meeting of the Association for Computational Linguistics (2017)
- C. N. Silla, "A survey of hierarchical classification across different application domains", Data Mining and Knowledge Discovery, 22 (2011)[DOI]
- H. Peng, "Large-scale hierarchical text classification with recursively regularized deep graph-cnn", Proceedings of WWW (2018)
- R. A. Stein, "An analysis of hierarchical text classification using word embeddings", Information Sciences, 471 (2019)[DOI]
- S. Dumais, "Hierarchical classification of Web content", Proceedings of the ACM SIGIR conference on Research and development in information retrieval (2000)
- J. Zhou, "Hierarchy-Aware Global Model for Hierarchical Text Classification", Proceedings of the Annual Meeting of the Association for Computational Linguistics (2020)
- Y. Zhang, "MATCH : Metadata-Aware Text Classification in A Large Hierarchy", Proceedings of the Web Conference 2021 (2021)
- B. Wang, "Cognitive structure learning model for hierarchical multi-label text classification", Knowledge-Based Systems, 218 (2021)[DOI]
- H. Peng, "Hierarchical Taxonomy-Aware and Attentional Graph Capsule RCNNs for Large-Scale Multi-Label Text Classification", IEEE Transactions on Knowledge and Data Engineering, 33 (2021)[DOI]
- N. Aljedani, "HMATC: Hierarchical multi-label Arabic text classification model using machine learning", Egyptian Informatics Journal, 22 (2021)[DOI]
- B. Jang, "Word2vec convolutional neural networks for classification of news articles and tweets", Plos One, 14(8) (2019)[DOI]
- J. Pennington, "GloVe : Global Vectors for Word Representation", Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (2014)
- "DBpedia"[URL]
- "ACM Digital Library"[URL]