유해어 필터링과 SVM을 이용한 유해 문서 분류 시스템
Harmful Document Classification Using the Harmful Word Filtering and SVM
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
오늘날 웹이 일반화되면서 사람들은 원하는 정보를 웹을 통해 얻고, 또한 제공하고 있다. 웹이 다양한 정보의 제공과 습득의 장이라는 편의성을 제공하고 있지만, 반면에 너무 많은 정보, 무분별한 유해 정보의 범람 등 여러 가지 문제를 내포하고 있다. 현재 유해 웹 문서를 분류하기 위한 다양한 방법이 연구되고 사용되고 있다. 그러나 각각의 방법들이 갖는 단점들로 인해 획기적인 성과를 내지 못하고 있다. 본 논문에서는 유해 정보로부터 사회적으로 보호를 받아야 할 사용자들을 보호하기 위한 수단으로 유해 웹 문서 차단 방법에 대해 제안하고자 한다. 본 논문에서는 키워드 필터링과 SVM 알고리즘을 이용한 2단계 분류 과정을 통해 분류의 정확률을 높이고자 하였다.
Abstract
As World Wide Web is more popularized nowadays, the environment is flooded with the information through the web pages. However, despite such convenience of web, it is also creating many problems due to uncontrolled flood of information. The pornographic, violent and other harmful information freely available to the youth, who must be protected by the society, or other users who lack the power of judgment or self-control is creating serious social problems. To resolve those harmful words, various methods proposed and studied. This paper proposes and implements the protecting system that it protects internet youth user from harmful contents. To classify effective harmful/harmless contents, this system uses two step classification systems that is harmful word filtering and SVM learning based filtering. We achieved result that the average precision of 92.1%.
참고문헌 (20)
- "A Practical Guide to Support Vector Classification"[URL]
- Christopher D. Hunter, "Internet Filter Effectiveness : Testing Over and Underinclusive Blocking Decisions of Four Popular Filters", Proceedings of the tenth conference on Computers, freedom and privacy: challenging the assumptions,, pp.287~294 (2000)
- Dequan Zheng, "Research of Machine Learning Method for Specific Information Recognition on the Internet", IEEE International Conference on Multimedia Interfaces(ICMI) (2002)
- Huicheng Zheng, "Blocking Objectionable Image : Adult Images and Harmful Symbols", IEEE International Conference on Multimedia and Expo(ICME), pp.1223~1226 (2004)
- Jae-Sun Lee, "A Study on the Effective Selective Filtering Technology of Harmful Website Using Internet Content Rating Service", Communication of KIPS Review, 9(2) (2002)
- KwangHyun Kim, "Detecting Harmful Web Documents Based on Web Document Analyses", Communication of KIPS Review, 12-D(5), pp.683~688 (2005)
- M. Hammami, "WebGuard: Web Based Adult Content Detection and Filtering System", IEEE WIC International Conference. Web Intelligence, pp.574~578 (2003)
- Mohamed Hammami, "WebGuard: A Web Filtering Engine Combining Textual, Structural, and Visual Content-Based Analysis", IEEE Transaction On Knowledge and Data Engineering, 18(2) (2006)
- Nello Cristianini, "An Introduction to Support Vector Machines and other kernel-based learning methods" (2000), Cambridge university press
- P.Y. Lee, "An Intelligent Categorization Engine for Bilingual Web Content Filtering", IEEE Transaction On Multimedia, 7(6) (2005)
- P.Y.Lee, "Networks for Web Content Filtering", IEEE Intelligent Systems, pp.48~57 (2002)
- Qing Yang, "SUPPORT VECTOR MACHINE FOR CUSTOMIZED EMAIL FILTERING BASED ON IMPROVING LATENT SEMANTIC INDEXING", Proceedings of the Fourth International conference on Machine Learning and Cybernetics, pp.3787~3791 (2005)
- Seung-Man Lee, "Implementation of a Harmful Website’s Automatic Classification System based on Morphological Analysis and Skin- Color Distribution’s Human Detection Algorithm", KISS Spring Conference, 31(1), pp.601~603 (2004)
- Thorsten Joachims, "Learning to Classify Text using Support Vector Machines" (2002), Kluwer Academic Publishers
- Yun-Jung Jang, "The Method of Hurtfulness Site Interception Using Poisonous Character Weight", KIPS Spring Conference, 10(1), pp.2185~2188 (2003)
- "LIBSVM:a Library for Support Vector Machines"[URL]
- 김영수, "등급에 따른 웹 유해 문서 분류 기술", 정보처리학회논문지C, 13(7), pp.859~864 (2006), 한국정보처리학회
- 김영택, "자연언어처리" (2003), 생능출판사
- 권용진, "정보검색개론" (2003), 도서출판 미래컴
- Reed J.W, "“TF-ICF, A New Term Weighting Scheme for Clustering Dynamic Data Streams,” Machine Learning and Applications", ICMLA ’06. 5th International Conference, pp.258~263 (2006)