Inverted Index based Modified Version of KNN for Text Categorization
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This research proposes a new strategy where documents are encoded into string vectors and modified version of KNN to be adaptable to string vectors for text categorization. Traditionally, when KNN are used for pattern classification, raw data should be encoded into numerical vectors. This encoding may be difficult, depending on a given application area of pattern classification. For example, in text categorization, encoding full texts given as raw data into numerical vectors leads to two main problems: huge dimensionality and sparse distribution. In this research, we encode full texts into string vectors, and modify the supervised learning algorithms adaptable to string vectors for text categorization.
Abstract
This research proposes a new strategy where documents are encoded into string vectors and modified version of KNN to be adaptable to string vectors for text categorization. Traditionally, when KNN are used for pattern classification, raw data should be encoded into numerical vectors. This encoding may be difficult, depending on a given application area of pattern classification. For example, in text categorization, encoding full texts given as raw data into numerical vectors leads to two main problems: huge dimensionality and sparse distribution. In this research, we encode full texts into string vectors, and modify the supervised learning algorithms adaptable to string vectors for text categorization.
참고문헌 (18)
- Androutsopoulos, K. Koutsias, "An Experimental Comparison of Naïve Bayes and Keyword-based Anti-spam Filtering with personal email message", The Proceedings of 23rd ACM SIGIR, pp.160~167 (2000)
- N. Cristianini, "Support Vector Machines and Other Kernel-based Learning Methods" (2000), Cambridge University Press
- H. Drucker, "Support Vector Machines for Spam Categorization", IEEE Transaction on Neural Networks, 10(5), pp.1048~1054 (1999)
- A. Estabrooks, "A Multiple Resampling Method for Learning from Imbalanced Data Sets", Computational Intelligence, 28(1), pp.18~26 (2004)
- M. Hearst, "Support Vector Machines", IEEE Intelligent Systems, 13(4), pp.18~28 (1998)
- P. Jackson, "Natural Language Processing for Online Applications: Text Retrieval, Extraction and Categorization" (2002), John Benjamins Publishing Company
- T. Joachims, "Text Categorization with Support Vector Machines: Learning with many Relevant Features", The Proceedings of 10th European Conference on Machine Learning, pp.143~151 (1998)
- T. Jo, "Class Imbalances versus Small Disjuncts", ACM SIGKDD Exploration Newsletters, 6(1), pp.40~49 (2004)
- T. Jo, "Text Clustering using NTSO", The Proceedings of IJCNN, pp.558~563 (2005)
- R. R. Korfahage, "Information Storage and Retrieval" (1997), Wiley Computer Publishing
- H. Lodhi, "Text Classification with String Kernels", Journal of Machine Learning Research, 2(2), pp.419~444 (2002)
- B. Massand, "Classifying News Stories using Memory based Reasoning", The Proceedings of 15th ACM International Conference on Research and Development in Information Retrieval, pp.59~65 (1992)
- T. Mitchell, "Machine Learning" (1997), McGraw-Hill
- D. Mladenic, "Feature Selection for unbalanced class distribution and Naïve Bayes", The Proceedings of International Conference on Machine Learning, pp.256~267 (1999)
- M. E. Ruiz, "Hierarchical Text Categorization Using Neural Networks", Information Retrieval, 5(1), pp.87~118 (2002)
- F. Sebastiani, "Machine Learning in Automated Text Categorization", ACM Computing Survey, 34(1), pp.1~47 (2002)
- E. D. Wiener, "A Neural Network Approach to Topic Spotting in Text", 석사, pp.1995
- Y. Yang, "An evaluation of statistical approaches to text categorization", Information Retrieval, 1(1), pp.67~88 (1999)