딥러닝 기반 기사단위 및 문단 단위별 분류
A Deeping Learning-based Article- and Paragraph-level Classification
2
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
Text classification has been studied for a long time in the Natural Language Processing field. In this paper, we propose an article- and paragraph-level genre classification system using Word2Vec-based LSTM, GRU, and CNN models for large-scale English corpora. Both article- and paragraph-level classification performed best in accuracy with LSTM, which was followed by GRU and CNN in accuracy performance. Thus, it is to be confirmed that in evaluating the classification performance of LSTM, GRU, and CNN, the word sequential information for articles is better than the word feature extraction for paragraphs when the pre-trained Word2Vec-based word embeddings are used in both deep learning-based article- and paragraph-level classification tasks.
Abstract
Text classification has been studied for a long time in the Natural Language Processing field. In this paper, we propose an article- and paragraph-level genre classification system using Word2Vec-based LSTM, GRU, and CNN models for large-scale English corpora. Both article- and paragraph-level classification performed best in accuracy with LSTM, which was followed by GRU and CNN in accuracy performance. Thus, it is to be confirmed that in evaluating the classification performance of LSTM, GRU, and CNN, the word sequential information for articles is better than the word feature extraction for paragraphs when the pre-trained Word2Vec-based word embeddings are used in both deep learning-based article- and paragraph-level classification tasks.
참고문헌 (21)
- "COCA"[URL]
- "Sejong Corpus"[URL]
- J. Swales, "Genre Analysis: English in Academic and Research Settings" (1990), Cambridge University Press
- D. Biber, "Variation across Speech and Writing" (1988), Cambridge University Press
- D. M. Blei, "Probabilistic Topic Models", Communications of the ACM, 55(4), pp.77~84 (2012)
- Z. S. Harris, "Distributional Structure", pp.775~794 (1997), Springer
- N. Friedman, "Bayesian Network Classifiers", Machine Learning, 29(2-3), pp.131~163 (1997)
- H. Jo, "Large-Scale Text Classification with a Convolutional Neural Network", 42th The Korean Institute of Information Scientists and Engineers Annual Meetings (2015)
- H. Jo, "Large-Scale Text Classification with Recurrent Neural Networks", 43th The Korean Institute of Information Scientists and Engineers Annual Meetings (2016)
- T. Young, "Recent Trends in Deep Learning Based Natural Language Processing", arXiv:1708.02709, ~ (2018)
- T. Mikolov, "Efficient estimation of word representations in vector space", arXiv:1301.3781, ~ (2013)
- Q. Le, "Distributed representations of sentences and documents", International Conference on Machine Learning, pp.1188~1196 (2014)
- C. Goller, "Learning task-dependent distributed representations by backpropergation through structure", Neural Networks, IEEE International Conference, 1 (1996)
- S. Hochreiter, "Long short-term memory", Neural computation, 9(8), pp.1735~1780 (1997)
- K. Cho, "Learning phrase representations using RNN encoder-decoder for statistical machine translation", arXiv preprint arXiv:1406.1078, ~ (2014)
- R. Jozefowicz, "An empirical exploration of recurrent network architecture", Proceedings of the 32nd Intenational Conference on Machine Learning (2015)
- Y. LeCun, "The handbook of brain theory and neural networks", pp.255~258 (1995), MIT Press
- Yoon Kim, "Convoluntional Neural Networks for Sentence Classification", Empirical Methods on Natural Language Proceeding (2014)
- Y. Liu, "Neural Network Methods for Natural Language Processing", Computational Linguistics, 44, pp.193~195 (2018)
- 유은순, "TF-IDF와 소설 텍스트의 구조를 이용한 주제어 추출 연구", 한국컴퓨터정보학회논문지, 20(2), pp.121~129 (2015), 한국컴퓨터정보학회
- 박진규, "딥러닝 기법을 이용한 철도 운행 관련 비정형 SNS 메시지 정형화", 한국컴퓨터정보학회논문지, 23(7), pp.19~26 (2018), 한국컴퓨터정보학회[DOI]