논문에서의 핵심구 추출을 위한 단어 및 구 유형 용어의 가중치 조정
Adjusting Weights of Single-word and Multi-word Terms for Keyphrase Extraction from Article Text
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
핵심구 추출은 문서의 내용을 대표하는 주제 용어를 자동 추출하는 작업이다. 비지도 방식 핵심구 추출에서는 문서 텍스트로부터 핵심구 후보 용어가 되는 단어나 구를 추출하고 후보 용어에부여된 중요도에 기반하여 최종 핵심구들이 선택된다. 본 논문에서는 비지도 방식 핵심구 후보용어 중요도 계산에서 단어 유형 후보 용어와 구 유형 후보 용어의 중요도를 조정하는 방법을 제안한다. 이를 위해 핵심구 추출 대상 문서 텍스트로부터 후보 용어 집합의 타입-토큰 비율과 고빈도 대표 용어의 정보량을 단어 유형과 구 유형으로 구분하여 수집한 후 중요도 조정에 활용한다. 실험에서는 영어로 작성된 full-text 논문을 대상으로 구축된 4개 서로 다른 핵심구 추출 평가집합들을 사용하여 성능 평가를 수행하였고, 제안된 중요도 조정 방법은 3개 평가집합들에서 베이스라인 및 비교 방법들보다 높은 성능을 보였다.
Abstract
Given a document, keyphrase extraction is to automatically extract words or phrases which topically represent the content of the document. In unsupervised keyphrase extraction approaches, candidate words or phrases are first extracted from the input document, and scores are calculated for keyphrase candidates, and final keyphrases are selected based on the scores. Regarding the computation of the scores of candidates in unsupervised keyphrase extraction, this study proposes a method of adjusting the scores of keyphrase candidates according to the types of keyphrase candidates: word-type or phrase-type. For this, type-token ratios of word-type and phrase-type candidates as well as information content of high-frequency word-type and phrase-type candidates are collected from the input document, and those values are employed in adjusting the scores of keyphrase candidates. In experiments using four keyphrase extraction evaluation datasets which were constructed for full-text articles in English, the proposed method performed better than a baseline method and comparison methods in three datasets.
참고문헌 (20)
- P. Turney, "Learning Algorithms for Keyphrase Extraction", Information Retrieval, 2(4), pp.303~336 (2000)
- K. Hasan, "Automatic Keyphrase Extraction : A Survey of the State of the Art", Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, pp.1262~1273 (2014)
- S. El-Beltagy, "KP-Miner : Participation in SemEval-2", Proceedings of the 5th International Workshop on Semantic Evaluation, pp.190~193 (2010)
- R. Campos, "YAKE! Keyword extraction from single documents using multiple local features", Information Sciences, 509, pp.257~289 (2020)
- R. Mihalcea, "TextRank : Bringing Order into Texts", Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pp.404~411 (2004)
- C. Florescu, "PositionRank : An Unsupervised Approach to Keyphrase Extraction from Scholarly Documents", Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pp.1105~1115 (2017)
- F. Boudin, "Unsupervised Keyphrase Extraction with Multipartite Graphs", Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics : Human Language Technologies, pp.667~672 (2018)
- S. Kim, "SemEval-2010Task 5 : Automatic Keyphrase Extraction from Scientific Articles", Proceedings of the 5th International Workshop on Semantic Evaluation, pp.21~26 (2010)
- E. Papagiannopoulou, "A review of keyphrase extraction", Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 10(2) (2020)
- X. Wan, "Single document keyphrase extraction using neighborhood knowledge", Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence, pp.855~860 (2008)
- C. Florescu, "A New Scheme for Scoring Phrases in Unsupervised Keyphrase Extraction", Advances in Information Retrieval-39th European Conference on IR Research, pp.477~483 (2017)
- W. Johnson, "Studies in language behavior : A program of research", Psychological Monographs, 56(2), pp.1~15 (1944)
- B. Richards, "Type", Token Ratios : what do they really tell us?, 1987, pp.14(2), 201~209
- C. Shannon, "A mathematical theory of communication", Bell System Technical Journal, 27(3), pp.379~423 (1948)
- O. Medelyan, "Human-competitive tagging using automatic keyphrase extraction", Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pp.1318~1327 (2009)
- T. Nguyen, "Keyphrase Extraction in Scientific Publications", Proceedings of the 10th International Conference on Asian Digital Libraries, pp.317~326 (2007)
- Large Dataset for Keyphrases Extraction, "M. Krapivin", University of Trento, ~, pp.Tech Report #DISI-09-055 (2009)
- "Datasets of Automatic Keyphrase Extraction"[URL]
- M. Porter, "An Algorithm for Suffix Stripping", Program, 14(3), pp.130~137 (1980)
- "SpaCy"[URL]