Sentiment Analysis on 'HelloTalk' App Reviews Using NRC Emotion Lexicon and GoEmotions Dataset
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
During the post-pandemic period, the interest in foreign language learning surged, leading to increased usage of language-learning apps. With the rising demand for these apps, analyzing app reviews becomes essential, as they provide valuable insights into user experiences and suggestions for improvement. This research focuses on extracting insights into users' opinions, sentiments, and overall satisfaction from reviews of HelloTalk, one of the most renowned language-learning apps. We employed topic modeling and emotion analysis approaches to analyze reviews collected from the Google Play Store. Several experiments were conducted to evaluate the performance of sentiment classification models with different settings. In addition, we identified dominant emotions and topics within the app reviews using feature importance analysis. The experimental results show that the Random Forest model with topics and emotions outperforms other approaches in accuracy, recall, and F1 score. The findings reveal that topics emphasizing language learning and community interactions, as well as the use of language learning tools and the learning experience, are prominent. Moreover, the emotions of 'admiration' and 'annoyance' emerge as significant factors across all models. This research highlights that incorporating emotion scores into the model and utilizing a broader range of emotion labels enhances model performance.
Abstract
During the post-pandemic period, the interest in foreign language learning surged, leading to increased usage of language-learning apps. With the rising demand for these apps, analyzing app reviews becomes essential, as they provide valuable insights into user experiences and suggestions for improvement. This research focuses on extracting insights into users' opinions, sentiments, and overall satisfaction from reviews of HelloTalk, one of the most renowned language-learning apps. We employed topic modeling and emotion analysis approaches to analyze reviews collected from the Google Play Store. Several experiments were conducted to evaluate the performance of sentiment classification models with different settings. In addition, we identified dominant emotions and topics within the app reviews using feature importance analysis. The experimental results show that the Random Forest model with topics and emotions outperforms other approaches in accuracy, recall, and F1 score. The findings reveal that topics emphasizing language learning and community interactions, as well as the use of language learning tools and the learning experience, are prominent. Moreover, the emotions of 'admiration' and 'annoyance' emerge as significant factors across all models. This research highlights that incorporating emotion scores into the model and utilizing a broader range of emotion labels enhances model performance.
참고문헌 (19)
- "Forbes" (2020)[URL]
- "Language Exchange App Market - Growth, Trends and Forecast (2024-2032)" (2024)[URL]
- A. V. Rivera, "HelloTalk", CALICO Journal, 34(3), pp.384~392 (2017)
- A. Yadav, "Sentiment Analysis Using Deep Learning Architectures : A Review", Artificial Intelligence Review, 53(6), pp.4335~4385 (2020)
- A. Iqbal, "Sentiment Analysis of Consumer Reviews Using Deep Learning", Sustainability, 14(17), pp.10844~ (2022)
- R. Das, "Multimodal Sentiment Analysis : A Survey of Methods, Trends, and Challenges", ACM Computing Surveys, 55(13), pp.1~38 (2023)
- D. M. Blei, "Latent Dirichlet Allocation", Journal of Machine Learning Research, 3, pp.993~1022 (2003)
- B. C. Lee, "Deriving the Determinants of Hotel Service Quality using OTA Reviews-LDA Topic Modeling-", Journal of Hotel & Resort, 19(4), pp.41~58 (2020)
- P. Nandwani, "A review on sentiment analysis and emotion detection from text", Social Network Analysis and Mining, 11(1), pp.81~ (2021)
- M. S. I. Malik, "Helpfulness of Product Reviews as a Function of Discrete Positive and Negative Emotions", Computers in Human Behavior, 73, pp.290~302 (2017)
- P. Ekman, "An Argument for Basic Emotions", Cognition and Emotion, 6(3), pp.169~200 (1992)
- S. M. Mohammad, "NRC Emotion Lexicon" (2013), National Research Council Canada
- Y. L. S. Krishna, "Sentiment Analysis of Product Reviews by using Naive Bayes and Vader Models", ICSSIT, pp.1~6 (2023)
- R. W. Picard, "Affective Computing" (1997), MIT Press
- L. A. M. Bostan, "An analysis of annotated corpora for emotion classification in text", ICCL, pp.2104~2119 (2018)
- H. B. Jung, "A Text-Based Emotion Analysis of the Audiences in a Webtoon-Based TV Drama : Focusing on <The Uncanny Counter>", Journal of Digital Contents Society, 24(4), pp.755~764 (2023)
- Kantorov, "Efficient Feature Extraction, Encoding, and Classification for Action Recognition", CVPR, pp.2593~2600 (2014)