본문 바로가기
KERD
논문KCI 등재

머리착용 디스플레이에 의해 유발된 멀미 증상이 동공 리듬의 안정성에 미치는 영향

Effect of Simulator Sickness Caused by Head-mounted Display on the Stability of the Pupillary Rhythm

이동원|문성철|황민철|박상인|김홍익
한국감성과학회 (The Korean Society For Emotion & Sensibility)|2018.12|감성과학 (Science of Emotion & Sensibility)|제21권 제4호|pp. 43-54|DOI https://doi.org/10.14695/KJSOS.2018.21.4.43

0

조회

0

다운로드

3

인용

0

참고문헌

키워드

인지 부하Cognitive Load멀미머리 착용 디스플레이Motion Sickness동공 반응비 접촉식 측정Pupillary ResponseNon-contact MeasurementHead Mounted Display (HMD)
주제분류감성과학

초록

본 연구는 멀미증상이 동공 리듬에 미치는 영향을 확인하는 것을 그 목적으로 하였다. 본 연구는 2D와 HMD를 통해 동일한 가상현실 콘텐츠를 실험참가자에게 15분 동안 경험하게 한 이후에 동공반응을 비교하였고 본 실험에는 16명(남자 8명, 여자 8명, 평균 나이: 25.67 ± 2.43세)의 피험자가 참여하였다. 연구 결과, 영상멀미를 경험한 이후에 동공 리듬이 불규칙한 패턴을 나타내었고 이것은 동공 크기(mPD) 동공 리듬의 편차(sPD)가 증가하는 결과로 확인되었다. 이러한 동공 반응의 결과는 인지부하와 밀접한 관련이 있고 영상멀미를 처리해야 할 시각 정보량의 증가 및 감각정보들 사이의 충돌 혹은 불일치로 인한 인지부하 현상으로 해석이 가능하다. 본 연구에서 제안된 방법은 기존의 센서 기반의 평가 방법에 비해 멀미 증상을 카메라 기반의 비접촉식으로 측정할 수 있는 가능성을 확인하였다.

Abstract

The aim of this study is to determine the effect of motion sickness on pupil rhythm. Sixteen volunteers of both genders (8 male, 8 female, mean age 25.67 ± 2.43 years) experienced VR contents in both 2D and HMD versions for 15 minutes, and their pupillary rhythms were compared. The irregular pattern of the pupillary rhythms, as demonstrated by increasing mean pupil diameter (mPD) and standard deviation of the pupil diameter (sPD), revealed motion sickness after experiencing HMD condition. The pupillary response is strongly related to the cognitive load, and the motion sickness can be interpreted as a change in the cognitive load caused by the increasing volume of visual information that must be processed and the conflict or inconsistency between different sensory modalities. The method proposed in this study could be a non-contact measurement method for the monitoring of motion sickness using a web-camera rather than previous sensor-based methods.

참고문헌 (55)

  1. Andreassi, J. L., "Psychophysiology: Human behavior & physiological response" (2013), Psychology Press
  2. Jeremy Bailenson, "The Effect of Interactivity on Learning Physical Actions in Virtual Reality", Media Psychology, 11(3), pp.354~376 (2008), Informa UK Limited[DOI]
  3. Beatty, J., "Neurophysiology and psychophysiology: Experimental and clinical applications", pp.138~143 (1988)
  4. Biocca, F., "Immersive virtual reality technology", Communication in the Age of Virtual Reality, 15, pp.57~124 (1995)
  5. Bouchard, S., "Exploring new dimensions in the assessment of virtual reality induced side effects", Journal of Computer and Information Technology, 1(3), pp.20~32 (2011)
  6. Buckner, R. L., "The brain's default network: origins and implications for the study of psychosis", Dialogues in Clinical Neuroscience, 15(3), pp.351~358 (2013)
  7. Kieran Carnegie, "Reducing Visual Discomfort with HMDs Using Dynamic Depth of Field", IEEE Computer Graphics and Applications, 35(5), pp.34~41 (2015), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  8. Jean-Rémy Chardonnet, "Features of the Postural Sway Signal as Indicators to Estimate and Predict Visually Induced Motion Sickness in Virtual Reality", International Journal of Human–Computer Interaction, 33(10), pp.771~785 (2017), Informa UK Limited[DOI]
  9. Siyuan Chen, "Using Task-Induced Pupil Diameter and Blink Rate to Infer Cognitive Load", Human–Computer Interaction, 29(4), pp.390~413 (2014), Informa UK Limited[DOI]
  10. Shang-Wen Chuang, "EEG Alpha and Gamma Modulators Mediate Motion Sickness-Related Spectral Responses", International Journal of Neural Systems, 26(02), pp.1650007~ (2016), World Scientific Pub Co Pte Lt[DOI]
  11. Daugman, J., "Iris recognition border-crossing system in the UAE", International Airport Review, 8(2), pp.49~53 (2004)
  12. Charles W. Dunnett, "A Multiple Comparison Procedure for Comparing Several Treatments with a Control", Journal of the American Statistical Association, 50(272), pp.1096~1121 (1955), Informa UK Limited[DOI]
  13. R. Becket Ebitz, "Neuronal Activity in Primate Dorsal Anterior Cingulate Cortex Signals Task Conflict and Predicts Adjustments in Pupil-Linked Arousal", Neuron, 85(3), pp.628~640 (2015), Elsevier BV[DOI]
  14. Ronny Geva, "Alerting, orienting or executive attention networks: differential patters of pupil dilations", Frontiers in Behavioral Neuroscience, 7 (2013), Frontiers Media SA[DOI]
  15. John F Golding, "Motion sickness susceptibility questionnaire revised and its relationship to other forms of sickness", Brain Research Bulletin, 47(5), pp.507~516 (1998), Elsevier BV[DOI]
  16. Linbi Hong, "Your Eyes Give You Away: Prestimulus Changes in Pupil Diameter Correlate with Poststimulus Task-Related EEG Dynamics", PLoS ONE, 9(3), pp.e91321~ (2014), Public Library of Science (PLoS)[DOI]
  17. Huck, S. W., "Reading statistics and research", pp.74~102 (1974), Harper & Row
  18. Jeong, S. H., "Motion sickness", Korean Journal of Aerospace and Environmental Medicine, 19(3), pp.87~90 (2010)
  19. Siddhartha Joshi, "Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex", Neuron, 89(1), pp.221~234 (2016), Elsevier BV[DOI]
  20. Edmilson D. Dos Santos Júnior, "The centrally projecting Edinger–Westphal nucleus—I: Efferents in the rat brain", Journal of Chemical Neuroanatomy, 68, pp.22~38 (2015), Elsevier BV[DOI]
  21. Marcel A. Just, "The intensity dimension of thought: Pupillometric indices of sentence processing.", Canadian Journal of Experimental Psychology, 1993, pp.47(2), 310~339[DOI]
  22. M. A. Just, "Brain Activation Modulated by Sentence Comprehension", Science, 274(5284), pp.114~116 (1996), American Association for the Advancement of Science (AAAS)[DOI]
  23. Robert S. Kennedy, "Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness", The International Journal of Aviation Psychology, 3(3), pp.203~220 (1993), Informa UK Limited[DOI]
  24. Robert S. Kennedy, "Research in visually induced motion sickness", Applied Ergonomics, 41(4), pp.494~503 (2010), Elsevier BV[DOI]
  25. H. J. Keselman, "Statistical Practices of Educational Researchers: An Analysis of their ANOVA, MANOVA, and ANCOVA Analyses", Review of Educational Research, 68(3), pp.350~386 (2016), American Educational Research Association (AERA)[DOI]
  26. Mehmet Kesim, "Augmented Reality in Education: Current Technologies and the Potential for Education", Procedia - Social and Behavioral Sciences, 47, pp.297~302 (2012), Elsevier BV[DOI]
  27. Young Youn Kim, "Characteristic changes in the physiological components of cybersickness", Psychophysiology, 0(0), pp.616~625 (2005), Wiley[DOI]
  28. Kiryu, T., "Integrated evaluation of visually induced motion sickness in terms of autonomic nervous regulation", Engineering in Medicine and Biology Society, 2008. EMBS 2008. 30th Annual International Conference of the IEEE, pp.4597~4600 (2008)
  29. Klingner, J., "Measuring the task-evoked pupillary response with a remote eye tracker", Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, pp.69~72 (2008)
  30. Tamás Kozicz, "The Edinger-Westphal nucleus: A historical, structural, and functional perspective on a dichotomous terminology", The Journal of Comparative Neurology, 519(8), pp.1413~1434 (2011), Wiley[DOI]
  31. Christina M. Krause, "Effects of pulsed and continuous wave 902 MHz mobile phone exposure on brain oscillatory activity during cognitive processing", Bioelectromagnetics, 28(4), pp.296~308 (2007), Wiley[DOI]
  32. Marc Lambooij, "Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review", Journal of Imaging Science and Technology, 53(3), pp.030201~ (2009), Society for Imaging Science & Technology[DOI]
  33. Eui Chul Lee, "Measuring the degree of eyestrain caused by watching LCD and PDP devices", International Journal of Industrial Ergonomics, 39(5), pp.798~806 (2009), Elsevier BV[DOI]
  34. Omar Merhi, "Motion Sickness, Console Video Games, and Head-Mounted Displays", Human Factors: The Journal of the Human Factors and Ergonomics Society, 49(5), pp.920~934 (2016), SAGE Publications[DOI]
  35. Sungchul Mun, "SSVEP and ERP measurement of cognitive fatigue caused by stereoscopic 3D", Neuroscience Letters, 525(2), pp.89~94 (2012), Elsevier BV[DOI]
  36. Sungchul Mun, "Effect of mental fatigue caused by mobile 3D viewing on selective attention: An ERP study", International Journal of Psychophysiology, 94(3), pp.373~381 (2014), Elsevier BV[DOI]
  37. Eugene Nalivaiko, "Cybersickness provoked by head-mounted display affects cutaneous vascular tone, heart rate and reaction time", Physiology & Behavior, 151, pp.583~590 (2015), Elsevier BV[DOI]
  38. Naqvi, S. A. A., "Does 3D produce more symptoms of visually induced motion sickness?", Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE, pp.6405~6408 (2013)
  39. Charles M. Oman, "Motion sickness: a synthesis and evaluation of the sensory conflict theory", Canadian Journal of Physiology and Pharmacology, 68(2), pp.294~303 (1990), Canadian Science Publishing[DOI]
  40. Ong, S. K., "Virtual and augmented reality applications in manufacturing" (2013), Springer Science & Business Media
  41. S. Park, "Does visual fatigue from 3D displays affect autonomic regulation and heart rhythm?", International Journal of Psychophysiology, 92(1), pp.42~48 (2014), Elsevier BV[DOI]
  42. Sangin Park, "Evaluation of 3D cognitive fatigue using heart–brain synchronization", International Journal of Psychophysiology, 97(2), pp.120~130 (2015), Elsevier BV[DOI]
  43. Sangin Park, "Non-contact measurement of heart response reflected in human eye", International Journal of Psychophysiology, 123, pp.179~198 (2018), Elsevier BV[DOI]
  44. Sangin Park, "Infrared Camera-Based Non-contact Measurement of Brain Activity From Pupillary Rhythms", Frontiers in Physiology, 9 (2018), Frontiers Media SA[DOI]
  45. Timo Partala, "Pupil size variation as an indication of affective processing", International Journal of Human-Computer Studies, 59(1-2), pp.185~198 (2003), Elsevier BV[DOI]
  46. N.R. Raajan, "Augmented Reality Based Virtual Reality", Procedia Engineering, 38, pp.1559~1565 (2012), Elsevier BV[DOI]
  47. Marie-Laure Ryan, "Immersion vs. Interactivity: Virtual Reality and Literary Theory", SubStance, 28(2), pp.110~137 (1999), University of Wisconsin Press[DOI]
  48. Greg J Siegle, "Pupillary assessment and computational modeling of the Stroop task in depression", International Journal of Psychophysiology, 52(1), pp.63~76 (2004), Elsevier BV[DOI]
  49. Masaaki Tanaka, "Neural effects of mental fatigue caused by continuous attention load: A magnetoencephalography study", Brain Research, 1561, pp.60~66 (2014), Elsevier BV[DOI]
  50. Nicola Toschi, "Motion sickness increases functional connectivity between visual motion and nausea-associated brain regions", Autonomic Neuroscience, 202, pp.108~113 (2017), Elsevier BV[DOI]
  51. Ruud L. van den Brink, "Pupil Diameter Tracks Lapses of Attention", PLOS ONE, 11(10), pp.e0165274~ (2016), Public Library of Science (PLoS)[DOI]
  52. Van Krevelen, D. W. F., "A survey of augmented reality technologies, applications and limitations", International Journal of Virtual Reality, 9(2), pp.1~20 (2010)
  53. Henk van Steenbergen, "Pupil dilation in the Simon task as a marker of conflict processing", Frontiers in Human Neuroscience, 7 (2013), Frontiers Media SA[DOI]
  54. Wang, Y., "An investigation of visual field test parameters in glaucoma, patterns of visual field loss in diabetics and multispectral imaging of the optic nerve head in glaucoma", Doctor, pp.2013
  55. Yoichi Yokota, "Motion sickness susceptibility associated with visually induced postural instability and cardiac autonomic responses in healthy subjects", Acta Oto-Laryngologica, 125(3), pp.280~285 (2009), Informa UK Limited[DOI]

관련 논문AI추천

VR 환경에서의 사이버 멀미 최소화를 위한 어지럼증 유발 원인 분석신정훈, 이재갑한국융합신호처리학회 · 융합신호처리학회 논문지2018 · 제19권 제3호기본 주시눈 위치의 패턴을 이용한 영상멀미의 민감도 예측문성철, 박상인, 이동원, 황민철한국융합학회 · 한국융합학회논문지2018 · 제9권 제11호FOV Restrictor를 활용한 가상 멀미 저감 요소 기술 연구김광욱, 김소연, 김창섭(사)한국컴퓨터그래픽스학회 · 한국컴퓨터그래픽스학회논문지2018 · 제24권 제3호가상현실(VR)에서 조작행위가 사이버멀미에 미치는 영향고윤서, 한정완한국디지털정책학회 · 디지털융복합연구2020 · 제18권 제6호3D HMD의 멀미증상 완화를 위한 조작방법에 관한 연구박의준, 이홍섭(사)한국컴퓨터게임학회 · 컴퓨터게임및콘텐츠논문지2014 · 제27권 제4호128 채널 뇌파를 이용한 사이버멀미 평가법 개발안봉영, 이동현, 임현균, 지경하, 한동욱한국감성과학회 · 감성과학2019 · 제22권 제3호

이 간행물의 다른 논문 (9건)

Decision-making of Consumers with Higher Pain of Payment: Moderating Role of Pain of Payment When Payment Conditions differ손영우, 고금정, 임혜빈pp. 3-10사회적 배제와 따뜻한 향 선호이국희pp. 11-24온라인 커뮤니티 속 가입차 지각된 유사성에 따른 평가의 차이유지현, 강현민, 한광희pp. 25-36LED 조명의 조도와 과제난이도가 장기기억에 미치는 영향이충원, 김진호pp. 37-42직물의 세부 구조 및 굴곡이 웨어러블 섬유의 발광 효과에 미치는 영향양진희, 오윤중, 이주현, 조현승, 곽휘권pp. 55-62
원문 보기