사전 학습된 BERT 기반 모델을 이용한 구어체 텍스트 요약
Text summarization of dialogue based on BERT
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
본 연구는 일목요연하게 정리되지 않은 구어체(대화)에 대한 텍스트 자동 요약 모델을 적용시키는 방법을 제안한다. 본 연구에서는 구어체 데이터인 SAMSum 데이터를 활용하였고, 선행연구에서 문어체 데이터 텍스트 자동 요약 모델 연구에서 제안한 BERTSumExtAbs 모델을 적용하였다. SAMSum 데이터셋은 70% 이상은 두 사람 간 대화, 나머지 약 30%는 세 사람 이상 간 대화로 구성되어 있다. 본 논문에서는 텍스트 자동 요약 모델을 구어체 데이터에 적용하여, ROUGE Score R-1 부문에서 42.43 이상의 결과를 도출해내었다. 또한, 텍스트 요약 모델로 기존에 제안된 모델인 BERTSum 모델을 fine-tuning하여, 45.81의 높은 점수를 도출했다. 본 연구를 통하여 구어체 데이터에 대한 텍스트 생성 요약의 성능을 입증하였으며, 앞으로 사람의 자연어를 있는 그대로 컴퓨터가 이해하여 다양한 task를 해결하는 데 기초 자료로 활용되길 바란다.
Abstract
In this paper, we propose how to implement text summaries for colloquial data that are not clearly organized. For this study, SAMSum data, which is colloquial data, was used, and the BERTSumExtAbs model proposed in the previous study of the automatic summary model was applied. More than 70% of the SAMSum dataset consists of conversations between two people, and the remaining 30% consists of conversations between three or more people. As a result, by applying the automatic text summarization model to colloquial data, a result of 42.43 or higher was derived in the ROUGE Score R-1. In addition, a high score of 45.81 was derived by fine-tuning the BERTSum model, which was previously proposed as a text summarization model. Through this study, the performance of colloquial generation summary has been proven, and it is hoped that the computer will understand human natural language as it is and be used as basic data to solve various tasks.
참고문헌 (15)
- Liu, Y, "Fine-tune BERT for extractive summarization", ~ (2019)
- Oh, Dongsuk, "KoDialoGPT2: Modeling Chit-Chat Dialog in Korean", Annual Conference on Human and Language Technology. Human and Language Technology (2021)
- Luhn H, "The automatic creation of literature abstracts", IBM J Res Dev, 2, pp.159~165 (1958)
- Dragomir R Radev, "Introduction to the special issue on summarization", Computational linguistics, 28(4), pp.399~408 (2002)
- Gambhir, Mahak, "Recent automatic text summarization techniques: a survey", Artificial Intelligence Review, 47(1), pp.1~66 (2017)
- Nallapati, Ramesh, "Summarunner:A recurrent neural network based sequence model for extractive summarization of documents", Thirty-first AAAI conference on artificial intelligence (2017)
- ZHOU, Qingyu, "Neural document summarization by jointly learning to score and select sentences", ~ (2018)
- Liu, Y, "Text summarization with pretrained encoders", EMNLP (2019)
- Feigenblat, G, "TWEETSUMM--A Dialog Summarization Dataset for Customer Service", EMNLP (2021)
- Bogdan Gliwa, "SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization", Proceedings of the 2nd Workshop on New Frontiers in Summarization, Association for Computational Linguistics (2019)
- Bert:Pre-training of deep bidirectional transformers for language understanding, "Devlin, J", NIPS, ~ (2019)
- Vaswani, Ashish, "Attention is all you need", Advances in neural information processing systems, 30 (2017)
- Abigail See, "Get to the point: Summarization with pointer generator networks", Proceedings of the 55th Annual Meeting of the Association for Computational, Linguistics (2017)
- Chin-Yew Lin, "Text Summarization Branches Out" (2004), Barcelona