심박변이도 기반 감정예측 인공신경망을 이용한 감정예측 추론과정 메커니즘에 관한 연구
Emotion prediction neural network to understand how emotion is predicted by using heart rate variability measurements
2
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Correct prediction of emotion is essential for developing advanced health devices. For this purpose, neural network has been successfully used. However, interpretation of how a certain emotion is predicted through the emotion prediction neural network is very tough. When interpreting mechanism about how emotion is predicted by using the emotion prediction neural network can be developed, such mechanism can be effectively embedded into highly advanced health-care devices. In this sense, this study proposes a novel approach to interpreting how the emotion prediction neural network yields emotion. Our proposed mechanism is based on HRV (heart rate variability) measurements, which is based on calculating physiological data out of ECG (electrocardiogram) measurements. Experiment dataset with 23 qualified participants were used to obtain the seven HRV measurement such as Mean RR, SDNN, RMSSD, VLF, LF, HF, LF/HF. Then emotion prediction neural network was modelled by using the HRV dataset. By applying the proposed mechanism, a set of explicit mathematical functions could be derived, which are clearly and explicitly interpretable. The proposed mechanism was compared with conventional neural network to show validity.
Abstract
Correct prediction of emotion is essential for developing advanced health devices. For this purpose, neural network has been successfully used. However, interpretation of how a certain emotion is predicted through the emotion prediction neural network is very tough. When interpreting mechanism about how emotion is predicted by using the emotion prediction neural network can be developed, such mechanism can be effectively embedded into highly advanced health-care devices. In this sense, this study proposes a novel approach to interpreting how the emotion prediction neural network yields emotion. Our proposed mechanism is based on HRV (heart rate variability) measurements, which is based on calculating physiological data out of ECG (electrocardiogram) measurements. Experiment dataset with 23 qualified participants were used to obtain the seven HRV measurement such as Mean RR, SDNN, RMSSD, VLF, LF, HF, LF/HF. Then emotion prediction neural network was modelled by using the HRV dataset. By applying the proposed mechanism, a set of explicit mathematical functions could be derived, which are clearly and explicitly interpretable. The proposed mechanism was compared with conventional neural network to show validity.
참고문헌 (43)
- D. E. Bloom, "The Global Economic Burden of Non-Communicable Diseases", Geneva, Switzerland: World Economic Forum (2011)
- J. Mervis, "Agencies rally to tackle big data", Science, 336(6077), pp.22~22 (2012)
- K. R. Kim, "Analysis on the Status of Korean Major Firms Entering into HT Fusion New Business", Korea Health Industry Development Institute (2014)
- J. A. Sacristan, "Patient-centered medicine and patient-oriented research: improving health outcomes for individual patients", BMC Medical Informatics and Decision Making, 13(1), pp.6~13 (2013)
- M. Phelan, "Towards a global definition of patient centred care", British Medical Journal, 322, pp.322~444 (2001)
- M. Ozkaynak, "Patient-centered care requires a patientoriented workflow model", Journal of the American Medical Informatics Association, 20(e1), pp.e14~e16 (2013)
- C. M. Tucker, "Patient-centered, culturally sensitive health care", American Journal of Lifestyle Medicine, 9(1), pp.63~77 (2015)
- S. M. Yoon, "Current Status and Prospects of Life Appliance based Healthcare System", The Journal of The Korean Institute of Communication Sciences, 31(12), pp.31~37 (2014)
- Y. L. Zheng, "Unobtrusive sensing and wearable devices for health informatics", IEEE Transactions on Biomedical Engineering, 61(5), pp.1538~1554 (2014)
- A. J. Wearden, "A review of expressed emotion research in health care", Clinical psychology review, 20(5), pp.633~666 (2000)
- B. Freshman, "Emotional intelligence: a core competency for health care administrators", The health care manager, 20(4), pp.1~9 (2002)
- Y. F. Birks, "Emotional intelligence and patient-centred care", Journal of the Royal Society of Medicine, 100(8), pp.368~374 (2007)
- S. Mann, "A health-care model of emotional labour: an evaluation of the literature and development of a model", Journal of health organization and management, 19(4-5), pp.304~317 (2005)
- C. D. Katsis, "An integrated system based on physiological signals for the assessment of affective states in patients with anxiety disorders", Biomedical Signal Processing and Control, 6(3), pp.261~268 (2011)
- P. A. Kragel, "Multivariate pattern classification reveals autonomic and experiential representations of discrete emotions", Emotion, 13(4), pp.681~690 (2013)
- J. Selvaraj, "Classification of emotional states from electrocardiogram signals: a non-linear approach based on hurst", Biomedical engineering online, 12(44) (2013)
- G. Valenza, "Revealing real-time emotional responses: a personalized assessment based on heartbeat dynamics", Scientific reports, 4(4998), pp.1~13 (2014)
- M. Swangnetr, "Emotional state classification in patient-robot interaction using wavelet analysis and statistics-based feature selection", IEEE Transactions on Human-Machine Systems, 43(1), pp.63~75 (2013)
- D. Kukolja, "Comparative analysis of emotion estimation methods based on physiological measurements for real-time applications", International Journal of Human-Computer Studies, 72(10), pp.717~727 (2014)
- C. M. Bishop, "Neural Networks for Pattern Recognition" (1995), Clarendon Press
- F. Stahl, "An overview of use of neural networks for data mining tasks", WIREs: Data Mining and Knowledge Discovery, pp.193~208 (2012)
- J. A. Anderson, "An Introduction to Neural Networks" (1995), MIT press
- B. D. Ripley, "Pattern Recognition and Neural Networks" (1996), Cambridge University Press
- G. D. Garson, "Interpreting neural-network connection weights", AI Expert, 6, pp.47~51 (1991)
- L. K. Milne, "Feature selection with neural networks with contribution measures", Proceedings of the Australian Conference on Artificial Intelligence AI’95 (1995)
- J. M. Zurada, "Sensitivity analysis for minimization of input data dimension for feedforward neural network", Proceedings of IEEE International Symposium on Circuits and Systems, 6, pp.447~450 (1994)
- D. E. Rumelhart, "Learning Internal Representations by Error Propagation", Parallel Distributed Processing, 1, pp.318~362 (1986)
- S. Haykin, "Neural Network" (1994), Prentice Hall
- P. De Wilde, "Neural network models: theory and projects" (2013), Springer Science & Business Media
- A. Haag, "Emotion recognition using bio-sensors: First steps towards an automatic system", Tutorial and research workshop on affective dialogue systems, pp.36~48 (2004)
- L. Ma, "Facial expression recognition using constructive feedforward neural networks", IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 34(3), pp.1588~1595 (2004)
- M. M. Monwar, "Pain recognition using artificial neural network. In Signal Processing and Information Technology", 2006 IEEE International Symposium on Signal Processing and Information Technology, pp.28~33 (2006)
- Y. S. Seol, "Emotion recognition from text using knowledge-based ANN", 23rd International Technical Conference on Circuits, 2008, 1569~1572
- C. N. Moridis, "Prediction of student’s mood during an online test using formula-based and neural network-based method", Computers & Education, 53(3), pp.644~652 (2009)
- M. A. Nicolaou, "Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space", IEEE Transactions on Affective Computing, 2(2), pp.92~105 (2011)
- F. A. Russo, "Predicting musically induced emotions from physiological inputs: Linear and neural network models", Frontiers in Psychology, 4(468) (2013)
- M. P. Tarvainen, "Kubios HRV-heart rate variability analysis software", Computer methods and programs in biomedicine, 113(1), pp.210~220 (2014)
- R. Hecht-Nielsen, "Theory of the Back Propagation Neural Network", Proceeding of the International Joint Conference on Neural Networks, pp.593~605 (1989)
- I. H. Witten, "Data Mining: Practical machine learning tools and techniques" (2005), Morgan Kaufmann
- 변성우, "IoT를 위한 음성신호 기반의 톤, 템포 특징벡터를 이용한 감정인식", 전기학회논문지, 65(1), pp.116~121 (2016), 대한전기학회[DOI]
- 강윤정, "멀티 모달 기반의 스마트 감성 주얼리", 한국정보통신학회논문지, 20(7), pp.1317~1324 (2016), 한국정보통신학회[DOI]
- P. S. Kim, "Technology and development trends related to human-friendly emotional robots", The Journal of The Korean Institute of Communication Sciences, 33(8), pp.19~27 (2016)
- C. D. Katsis, "An integrated system based on physiological signals for the assessment of affective states in patients with anxiety disorders", Biomedical Signal Processing and Control, 6(3), pp.261~268 (2011)