A Survey on Image Emotion Recognition
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Emotional semantics are the highest level of semantics that can be extracted from an image. Constructing a system that can automatically recognize the emotional semantics from images will be significant for marketing,smart healthcare, and deep human-computer interaction. To understand the direction of image emotion recognition as well as the general research methods, we summarize the current development trends and shed light on potential future research. The primary contributions of this paper are as follows. We investigate the color, texture, shape and contour features used for emotional semantics extraction. We establish two models that map images into emotional space and introduce in detail the various processes in the image emotional semantic recognition framework. We also discuss important datasets and useful applications in the field such as garment image and image retrieval. We conclude with a brief discussion about future research trends.
Abstract
Emotional semantics are the highest level of semantics that can be extracted from an image. Constructing a system that can automatically recognize the emotional semantics from images will be significant for marketing,smart healthcare, and deep human-computer interaction. To understand the direction of image emotion recognition as well as the general research methods, we summarize the current development trends and shed light on potential future research. The primary contributions of this paper are as follows. We investigate the color, texture, shape and contour features used for emotional semantics extraction. We establish two models that map images into emotional space and introduce in detail the various processes in the image emotional semantic recognition framework. We also discuss important datasets and useful applications in the field such as garment image and image retrieval. We conclude with a brief discussion about future research trends.
참고문헌 (41)
- W. Wang, "Emotion-based image semantic query through color description", Journal of South China University of Technology(Natural Science Edition), 36(1), pp.60~66 (2008)
- T. C. Merlo, "Measuring dynamics of emotions evoked by the packaging colour of hamburgers using Temporal Dominance of Emotions(TDE)", Food Research International, 124, pp.147~155 (2019)
- Jizheng Yi, "Facial expression recognition of intercepted video sequences based on feature point movement trend and feature block texture variation", Applied Soft Computing, 82, pp.105540~ (2019), Elsevier BV[DOI]
- A. Barman, "Facial expression recognition using distance and texture signature relevant features", Applied Soft Computing, 77, pp.88~105 (2019)
- S. M. Alarcao, "Reminiscence therapy improvement using emotional information", Proceedings of 20177th International Conference on Affective Computing and Intelligent Interaction (ACII),, pp.561~565 (2017)
- S. Wang, "Review of image low-level feature extraction methods for content-based image retrieval", Sensor Review, 39(6), pp.783~809 (2019)
- J. Yao, "Sentiment prediction in scene images via convolutional neural networks", Proceedings of 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC), pp.196~200 (2016)
- C. Colombo, "Semantics in visual information retrieval", IEEE Multimedia, 6(3), pp.38~53 (1999)
- N. Jamil, "Face recognition using neural networks", Proceedings of IEEE International Multi Topic Conference: Technology for the 21st Century (INMIC),, pp.277~281 (2001)
- Y. Yu, "Research of perceptive information of image", Acta Electronica Sinica, 29(10), pp.1373~1375 (2001)
- Z. Li, "Directive local color transfer based on dynamic lookup table", Signal Processing : Image Communication, 79, pp.1~12 (2019)
- H. Zhang, "Study on the emotion factor space of fabric", Proceedings of the International Conference on Kansei Engineering and Emotion Research, pp.1174~1178 (2012)
- T. Hayashi, "Image query by impression words-the IQI system", IEEE Transactions on Consumer Electronics, 44(2), pp.347~352 (1998)
- S. Wang, "Kansei-based image evaluation and retrieval", Pattern Recognition and Artificial Intelligence, 14(3), pp.297~301 (2001)
- S. Zhao, "EmotionGAN : unsupervised domain adaptation for learning discrete probability distributions of image emotions", Proceedings of the 26th ACM International Conference on Multimedia, pp.1319~1327 (2018)
- H. Sadeghi, "Human vision inspired feature extraction for facial expression recognition", Multimedia Tools and Applications, 78(21), pp.30335~30353 (2019)
- S. Zhao, "Continuous probability distribution prediction of image emotions via multitask shared sparse regression", IEEE Transactions on Multimedia, 19(3), pp.632~645 (2016)
- L. Cai, "Robust facial expression recognition using RGB-D images and multichannel features", Multimedia Tools and Applications, 78(20), pp.28591~28607 (2019)
- F. Liu, "Deep learning of pre-classification for fast image retrieval", Proceedings of the 2018 International Conference on Algorithms, Computing and Artificial Intelligence, pp.1~5 (2018)
- K. Stallman, "Emotional Psychology" (1986), Liaoning People Press
- R. Plutchik, "The nature of emotions : human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice", American Scientist, 89(4), pp.344~350 (2001)
- M. Y. Tsalamlal, "Combining facial expression and touch for perceiving emotional valence", IEEE Transactions on Affective Computing, 9(4), pp.437~449 (2016)
- Y. Y. Gao, "Research on affective annotation for natural scene images", Journal of Chinese Computer Systems, 32(4), pp.767~771 (2011)
- Y. Ye, "Facial expression recognition via region-based convolutional fusion network", Journal of Visual Communication and Image Representation, 62, pp.1~11 (2019)
- Q. Dai, "A kind of image retrieval based on texture features and BP neural network", Computer Science, 27(6), pp.55~57 (2000)
- A. R. Kurup, "Semi-supervised facial expression recognition using reduced spatial features and deep belief networks", Neurocomputing, 367, pp.188~197 (2019)
- J. Lee, "Fuzzy similarity-based emotional classification of color images", IEEE Transactions on Multimedia, 13(5), pp.1031~1039 (2011)
- R. V. Priya, "Emotion recognition from geometric fuzzy membership functions", Multimedia Tools and Applications, 78(13), pp.17847~17878 (2019)
- D. Palani, "An IoT Based Predictive Modelling for Predicting Lung Cancer Using Fuzzy Cluster Based Segmentation and Classification", Journal of Medical Systems, 43(2) (2019), Springer Science and Business Media LLC[DOI]
- C. Singh, "Enhancing color image retrieval performance with feature fusion and non-linear support vector machine classifier", Optik, 158, pp.127~141 (2018)
- Z. Sun, "Quantized wavelet features and support vector machines for on-road vehicle detection", Proceedings of 7th International Conference on Control, Automation, Robotics and Vision, pp.1641~1646 (2002)
- S. Zhao, "Exploring principles-of-art features for image emotion recognition", Proceedings of the 22nd ACM International Conference on Multimedia, pp.47~56 (2014)
- Q. You, "Building a large scale dataset for image emotion recognition: the fine print and the benchmark", Proceedings of the 30th AAAI Conference on Artificial Intelligence, pp.308~314 (2016)
- S. Corchs, "Ensemble learning on visual and textual data for social image emotion classification", International Journal of Machine Learning and Cybernetics, 10(8), pp.2057~2070 (2019)
- L. Poretski, "Feel the image : the role of emotions in the image-seeking process", Human–Computer Interaction, 34(3), pp.240~277 (2019)
- A. Hernandez-Garcia, "Perceived emotion from images through deep neural networks", Proceedings of 2017 7th International Conference on Affective Computing and Intelligent Interaction (ACII), pp.566~570 (2017)
- D. Kong, "Phase retrieval for attacking fractional Fourier transform encryption", Applied Optics, 56(12), pp.3449~3456 (2017)
- S. Wang, "Kansei-based image evaluation and retrieval", Pattern Recognition and Artificial Intelligence, 14(3), pp.297~301 (2001)
- J. Shawe-Taylor, "Kernel Methods for Pattern Analysis" (2004), Cambridge University Press
- Chih-Chung Chang, "LIBSVM", ACM Transactions on Intelligent Systems and Technology, 2(3), pp.1~27 (2011), Association for Computing Machinery (ACM)[DOI]
- S. Wang, "Research of emotion semantic image annotation and retrieval algorithm using support vector machine", Pattern Recognition and Artificial Intelligence, 17(1), pp.27~33 (2004)
