Impact of Word Embedding Methods on Performance of Sentiment Analysis with Machine Learning Techniques
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
In this study, we propose a comparative study to confirm the impact of various word embedding techniques on the performance of sentiment analysis. Sentiment analysis is one of opinion mining techniques to identify and extract subjective information from text using natural language processing and can be used to classify the sentiment of product reviews or comments. Since sentiment can be classified as either positive or negative, it can be considered one of the general classification problems. For sentiment analysis, the text must be converted into a language that can be recognized by a computer. Therefore, text such as a word or document is transformed into a vector in natural language processing called word embedding. Various techniques, such as Bag of Words, TF-IDF, and Word2Vec are used as word embedding techniques. Until now, there have not been many studies on word embedding techniques suitable for emotional analysis. In this study, among various word embedding techniques, Bag of Words, TF-IDF, and Word2Vec are used to compare and analyze the performance of movie review sentiment analysis. The research data set for this study is the IMDB data set, which is widely used in text mining. As a result, it was found that the performance of TF-IDF and Bag of Words was superior to that of Word2Vec and TF-IDF performed better than Bag of Words, but the difference was not very significant.
Abstract
In this study, we propose a comparative study to confirm the impact of various word embedding techniques on the performance of sentiment analysis. Sentiment analysis is one of opinion mining techniques to identify and extract subjective information from text using natural language processing and can be used to classify the sentiment of product reviews or comments. Since sentiment can be classified as either positive or negative, it can be considered one of the general classification problems. For sentiment analysis, the text must be converted into a language that can be recognized by a computer. Therefore, text such as a word or document is transformed into a vector in natural language processing called word embedding. Various techniques, such as Bag of Words, TF-IDF, and Word2Vec are used as word embedding techniques. Until now, there have not been many studies on word embedding techniques suitable for emotional analysis. In this study, among various word embedding techniques, Bag of Words, TF-IDF, and Word2Vec are used to compare and analyze the performance of movie review sentiment analysis. The research data set for this study is the IMDB data set, which is widely used in text mining. As a result, it was found that the performance of TF-IDF and Bag of Words was superior to that of Word2Vec and TF-IDF performed better than Bag of Words, but the difference was not very significant.
참고문헌 (17)
- T. A. Rana, "Aspect extraction in sentiment analysis : comparative analysis and survey", Artificial Intelligence Review, 46(4), pp.459~483 (2016)
- Q. T. Ain, "Sentiment analysis using deep learning techniques : a review", International Journal of Advanced Computer Science and Applications, 8(6), pp.424~433 (2017)
- A. Abdi, "Deep learning-based sentiment classification of evaluative text based on Multi-feature fusion", Information Processing & Management, 56(4), pp.1245~1259 (2019)
- B. Pang, "Thumbs up? Sentiment classification using machine learning techniques", Proc. of EMNLP 2002, pp.79~86 (2002)
- F. H. Khan, "SentiMI : Introducing point-wise mutual information with SentiWordNet to improve sentiment polarity detection", Applied Soft Computing, 39, pp.140~153 (2016)
- F. Tang, "Aspect based fine-grained sentiment analysis for online reviews", Information Sciences, 488, pp.190~204 (2019)
- C. Bhadane, "Sentiment analysis : Measuring opinions", Procedia Computer Science, 45(0), pp.808~814 (2015)
- T. Mikolov, "Distributed representations of words and phrases and their compositionality", Advances in Neural Information Processing Systems, pp.3111~3119 (2013)
- 김우주, "Word2vec을 활용한 문서의 의미 확장 검색방법", 한국콘텐츠학회 논문지, 16(10), pp.687~692 (2016), 한국콘텐츠학회[DOI]
- 성대경, "딥러닝을 활용한 정치 기사 댓글 분석", 한국컴퓨터정보학회논문지, 23(1), pp.9~15 (2018), 한국컴퓨터정보학회[DOI]
- 이태일, "Word2Vec과 가속화 계층적 밀집도 기반 클러스터링을 활용한 효율적 봇넷 탐지 기법", 인터넷정보학회논문지, 20(6), pp.11~20 (2019), 한국인터넷정보학회[DOI]
- 김유희, "딥러닝 기반 기사단위 및 문단 단위별 분류", 한국컴퓨터정보학회논문지, 23(11), pp.31~41 (2018), 한국컴퓨터정보학회[DOI]
- 박진규, "딥러닝 기법을 이용한 철도 운행 관련 비정형 SNS 메시지 정형화", 한국컴퓨터정보학회논문지, 23(7), pp.19~26 (2018), 한국컴퓨터정보학회[DOI]
- S. M. Liu, "A multi-label classification based approach for sentiment classification", Expert Systems with Applications, 42(3), pp.1083~1093 (2015)
- G. Gautam, "Sentiment analysis of twitter data using machine learning approaches and semantic analysis", Proc. of IC3, IEEE, pp.437~442 (2014)
- J. Read, "Using emoticons to reduce dependency in machine learning techniques for sentiment classification", Proceedings of the ACL Student Research Workshop, pp.43~48 (2005)
- L. Dey, "Sentiment analysis of review datasets using Naive Bayes and k-nn classifier", International Journal of Information Engineering and Electronic Business, 8(4), pp.54~62 (2016)