Machine Learning Based Keyphrase Extraction: Comparing Decision Trees, Naïve Bayes, and Artificial Neural Networks
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
The paper presents three machine learning based keyphrase extraction methods that respectively use Decision Trees, Naïve Bayes, and Artificial Neural Networks for keyphrase extraction. We consider keyphrases as being phrases that consist of one or more words and as representing the important concepts in a text document. The three machine learning based keyphrase extraction methods that we use for experimentation have been compared with a publicly available keyphrase extraction system called KEA. The experimental results show that the Neural Network based keyphrase extraction method outperforms two other keyphrase extraction methods that use the Decision Tree and Naïve Bayes. The results also show that the Neural Network based method performs better than KEA.
Abstract
The paper presents three machine learning based keyphrase extraction methods that respectively use Decision Trees, Naïve Bayes, and Artificial Neural Networks for keyphrase extraction. We consider keyphrases as being phrases that consist of one or more words and as representing the important concepts in a text document. The three machine learning based keyphrase extraction methods that we use for experimentation have been compared with a publicly available keyphrase extraction system called KEA. The experimental results show that the Neural Network based keyphrase extraction method outperforms two other keyphrase extraction methods that use the Decision Tree and Naïve Bayes. The results also show that the Neural Network based method performs better than KEA.
참고문헌 (28)
- Y. B. Wu, "Document keyphrases as subject metadata: incorporating document key concepts in search results", Journal of Information Retrieval, 11(3), pp.229~249 (2008)
- O. Buyukkokten, "Seeking the Whole in Parts: Text Summarization for Web Browsing on Handheld Devices", In Proceedings of the World Wide Web Conference (WWW10), Hong Kong (2001)
- O. Buyukkokten, "Efficient Web Browsing on Handheld Devices Using Page and Form Summarization", ACM Transactions on Information Systems (TOIS), 20(1), pp.82~115 (2002)
- S. Jones, "Phrasier: A system for interactive document retrieval using keyphrases", In: proceedings of SIGIR'99, Berkeley, CA (1999)
- C. Gutwin, "Improving browsing in digital libraries with keyphrase indexes", Journal of Decision Support Systems, 27(1-2), pp.81~104 (1999)
- B. Kosovac, "Use of keyphrase extraction software for creation of an AEC", FM thesaurus, 2000, pp.5, 25~36
- S. Jonse, "Hierarchical document clustering using automatically extracted keyphrase", In proceedings of the third international Asian conference on digital libraries, Seoul, Korea, pp.113~120 (2000)
- K. Barker, "Using Noun Phrase Heads to Extract Document Keyphrases", Canadian AI 2000. Lecture Notes in Artificial Intelligence, 1822, pp.40~52 (2000), pringer-Verlag
- L. F. Chien, "PAT-tree-based Adaptive Keyphrase Extraction for Intelligent Chinese Information Retrieval", Information Processing and Management, 35, pp.501~521 (1999)
- Y. HaCohen-Kerner, "Automatic Extraction of Keywords from Abstracts, In KES 2003", Lecture Notes in Artificial Intelligence, 2773, pp.843~849 (2003)
- Y. HaCohen-Kerner, "Automatic Extraction and Learning of Keyphrases from Scientific Articles, in CICLing 2005", Lecture Notes in Computer Science, 3406, pp.657~669 (2005)
- A. Hulth, "Automatic Keyword Extraction Using Domain Knowledge, in CICLing 2001", Lecture Notes in Computer Science, (2004), pp.472~482 (2001), Springer-Verlag
- Y. Matsuo, "KeyWorld: Extracting Keywords from a Document as a Small World, in DS 2001", Lecture Notes in Computer Science, 2226, pp.271~281 (2001), Springer-Verlag
- J. Wang, "Automatic Keyphrase Extraction from Document Using Neural Network", ICMLC 2005, pp.633~641 (2005)
- P. D. Turney, "Learning algorithm for keyphrase extraction", Journal of Information Retrieval, 2(4), pp.303~36 (2000)
- E. Frank, "Domain-specific keyphrase extraction", In: proceeding of the sixteenth international joint conference on artificial intelligence, San Mateo, CA (1999)
- I.H. Witten, "KEA: Practical Automatic Keyphrase Extraction, In Proceedings of Digital Libraries’99: The Fourth ACM Conference on Digital Libraries", pp.254~255 (1999), ACM Press
- N. Kumar, "Automatic keyphrase extraction from scientific documents using N-gram filtration technique", n Proceeding of the eighth ACM symposium on Document engineering, Sao Paulo, Brazil (2008)
- Q. Li, "Identifying important concepts from medical documents", Journal of Biomedical Informatics, pp.668~679 (2006)
- C. Fellbaum, "WordNet: An electronic lexical database" (1998), MIT Press
- "MontyLingua: An end-to-end natural language processor with common sense’, 2004"[URL]
- H. P. Edmundson, "New methods in automatic extracting", Journal of the Association for Computing Machinery, 16(2), pp.264~285 (1969)
- G.K. Zipf, "The psycho-biology of language" (1965), MIT press
- G. Holmes, "Weka: A machine learning workbench", In Proc Second Australia and New Zealand Conference on Intelligent Information Systems, Brisbane, Australia (1994)
- "Data Mining: Practical machine learning tools and techniques"[URL]
- U.M. Fayyad, "Multi-interval discretization of continuous-valued attributes for classification learning", In proceedings of 13th International Joint Conference on Artificial Intelligence, San Francisco, CA, Morgan Kaufmann, pp.1022~1027 (1993)
- J. R. Quinlan, "C4.5: Programs for Machine Learning" (1993), Morgan Kaufmann Publishers
- K. Sarkar, "Automatic Keyphrase Extraction from Medical Documents", Proceedings of the 3rd International Conference on Pattern Recognition and Machine Intelligence(PReMI 09), pp.273~278 (2009)