Convolutional Neural Network Model Using Data Augmentation for Emotion AI-based Recommendation Systems
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
In this study, we propose a novel research framework for the recommendation system that can estimate the user's emotional state and reflect it in the recommendation process by applying deep learning techniques and emotion AI (artificial intelligence). To this end, we build an emotion classification model that classifies each of the seven emotions of angry, disgust, fear, happy, sad, surprise, and neutral, respectively, and propose a model that can reflect this result in the recommendation process. However, in the general emotion classification data, the difference in distribution ratio between each label is large, so it may be difficult to expect generalized classification results. In this study, since the number of emotion data such as disgust in emotion image data is often insufficient, correction is made through augmentation. Lastly, we propose a method to reflect the emotion prediction model based on data through image augmentation in the recommendation systems.
Abstract
In this study, we propose a novel research framework for the recommendation system that can estimate the user's emotional state and reflect it in the recommendation process by applying deep learning techniques and emotion AI (artificial intelligence). To this end, we build an emotion classification model that classifies each of the seven emotions of angry, disgust, fear, happy, sad, surprise, and neutral, respectively, and propose a model that can reflect this result in the recommendation process. However, in the general emotion classification data, the difference in distribution ratio between each label is large, so it may be difficult to expect generalized classification results. In this study, since the number of emotion data such as disgust in emotion image data is often insufficient, correction is made through augmentation. Lastly, we propose a method to reflect the emotion prediction model based on data through image augmentation in the recommendation systems.
참고문헌 (31)
- P. Ekman, "Manual for the Facial Action Coding System" (1978), Consulting Psychologists Press
- M Pantic, "Expert system for automatic analysis of facial expressions", Image and Vision Computing, 18(11), pp.881~905 (2000), Elsevier BV[DOI]
- J. Russell, "A circumplex model of affect", Journal of Personality and Social Psychology, 39, pp.1161~1178 (1980)[DOI]
- T. Alashkar, "Examples-Rules Guided Deep Neural Network for Makeup Recommendation", Proceedings of AAAI, pp.941~947 (2017)
- Cheng Chen, "Location-Aware Personalized News Recommendation With Deep Semantic Analysis", IEEE Access, 5, pp.1624~1638 (2017), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- W. Niu, "Neural Personalized Ranking for Image Recommendation", Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp.423~431 (2018)
- X. Wang, "Dynamic Attention Deep Model for Article Recommendation by Learning Human Editors’ Demonstration", Proceedings of SIGKDD (2017)
- Z. Xu, "Tag-aware Personalized Recommendation using a Hybrid Deep Model", Proceedings of IJCAI-17 (2017)
- C. Yang, "Bridging Collaborative Filtering and Semi-Supervised Learning : A Neural Approach for POI Recommendation", Proceedings of SIGKDD (2017)
- L. Zheng, "Joint Deep Modeling of Users and Items Using Reviews for Recommendation", Proceedings of WSDM (2017)
- S. Cao, "Online news recommender based on stacked auto-encoder", Proceedings of ICIS, pp.721~726 (2017)
- Shuiguang Deng, "On Deep Learning for Trust-Aware Recommendations in Social Networks", IEEE Transactions on Neural Networks and Learning Systems, 28(5), pp.1164~1177 (2017), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- J. Lee, "Collaborative Deep Metric Learning for Video Understanding", Proceedings of KDD (2018)
- Q. Liu, "DeepStyle : Learning User Preferences for Visual Recommendation", Proceedings of SIGIR (2017)
- H. T. H. Nguyen, "Personalized Deep Learning for Tag Recommendation", Proceedings of PAKDD (2017)
- S. Seo, "Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction", Proceedings of Recsys, pp.297~305 (2017)
- J. Tang, "Personalized Top-n Sequential Recommendation Via Convolutional Sequence Embedding", Proceedings of WSDM, pp.565~573 (2018)
- S. Wang, "What Your Images Reveal: Exploiting Visual Contents for Point-of-Interest Recommendation", Proceedings of WWW (2017)
- X. Wang, "Item Silk Road:Recommending Items from Information Domains to Social Users" (2017)
- W. Yu, "Aesthetic-based Clothing Recommendation", Proceedings of WWW, pp.649~658 (2018)
- T. Donkers, "Sequential User-based Recurrent Neural Network Recommendations", Proceedings of Recsys, pp.152~160 (2017)
- H. Jing, "Neural Survival Recommender", Proceedings of WSDM, pp.515~524 (2017)
- S. Okura, "Embedding-based News Recommendation for Millions of Users", Proceedings of SIGKDD (2017)
- M. Quadrana, "Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks", Proceedings of Recsys, pp.130~137 (2017)
- X. Cai, "Generative Adversarial Network Based Heterogeneous Bibliographic Network Representation for Personalized Citation Recommendation", Proceedings of AAAI (2018)
- 홍의석, "클래스 불균형 데이터를 사용한 심각도 기반 소프트웨어 품질 예측", 한국컴퓨터정보학회논문지, 21(4), pp.73~80 (2016), 한국컴퓨터정보학회
- 김광성, "불균형 데이터 학습을 위한 지지벡터기계 알고리즘", 한국컴퓨터정보학회논문지, 15(7), pp.11~17 (2010), 한국컴퓨터정보학회
- A. Vulpe-Grigorași, "Convolutional Neural Network Hyperparameters optimization for Facial Emotion Recognition", Proceedings of ATEE (2021)
- "Facial Expression Recognition with Deep Learning" (2004)[URL]