본문 바로가기
KERD
논문KCI 등재

가상현실에서 아바타를 통한 정보전달 시 뇌의 활성화와 현존감의 관계

The Relationship between Brain Activities and Presence on Communication using and Avatar in Virtual Reality

김선일|김재진|김소영|김인영|남상원|이형래|윤강준|구정훈
한국인지과학회 (The Korean Society for Cognitive Science)|2006.12|인지과학 (Korean Journal of Cognitive Science)|제17권 제4호|pp. 357-373

2

조회

0

다운로드

6

인용

0

참고문헌

키워드

가상현실virtual realityfMRIpresence현존감뇌기능영상전대상피질후대상피질anterior cingulate cortexposterior cingulate cortex
주제분류인지과학

초록

가상현실은 감각기관에 전달하는 정보를 조작하여 가상의 경험을 피험자에게 제공하고, 사람은 가상현실에서 제공하는 감각적인 정보를 뇌에서 통합하여 상황을 판단한다. 그러한 판단을 통해 가상현실이 얼마나 실제와 같은지 아닌지 지각하고 판단하게 된다. 이렇게 어떤 특정한 또는 이해할 수 있는 장소에 존재한다고 생각하는 인간의 지각상태를 나타내는 요소를 ‘현존감’이라고 한다. 가상의 환경을 사용자가 실제처럼 느끼고 그 내용을 받아들이도록 하는 것은 중요한 목표이다. 또한 현존감은 가상현실에서 경험하게 되는 여러 가지 감각적인 정보들을 통하여 느끼는 종합적인 느낌을 반영한다. 따라서 여러 가지 감각적인 정보들을 통합하는 과정에서 현존감과 관련된 뇌의 메커니즘이 존재할 것이다. 현존감은 매체를 통한 정보전달 시, 매체에서 전달되는 여러 가지 정보나 자극에 대한 사용자의 지각 및 인식과 중요한 관련이 있기 때문에 현존감의 정도는 개인이 지각하는 정보의 명확성에 영향을 준다. 이를 알아보기 위해서 사회적인 상황에서의 명확성의 차이를 가지는 내용을 아바타를 통해 전달하고 피험자가 그 내용을 바탕으로 추론해보는 가상현실을 구성하였다. 그리고 피험자가 전달받은 내용을 바탕으로 추론하는 동안 뇌 영역 활성화의 차이와 가상현실에 대한 현존감 점수가 관련된 뇌 영역을 알아보았다. 실험 결과 우측 혀이랑, 우측 쐐기소엽, 좌측 혀이랑, 우측 방추상이랑, 좌측 하측두이랑, 전대상피질 그리고 우측 후대상피질에서 유의미한 양의 상관관계가 있었다. 본 연구는 가상현실을 통한 정보의 전달 시 현존감의 영향을 뇌 기능영상 촬영을 통해서 내부 메커니즘의 측면에서 살펴보았다는 것에 의의가 있다.

Abstract

Virtual reality (VR) provides a virtual experiment (VE) context consisting of information presented to the senses of the user. The user perceives and interprets the VE context, and then naturally recognizes a level of realism in the VE. Presence is often thought of as the sense of ‘being there’ in the VE. Presence includes overall feelings about the information conveyed from a virtual avatar to the user. Therefore, there must be brain mechanisms for integrating sensory information about presence. ‘Feeling of presence’ is related with the user's cognition and perception about information on communication through medium. Thus ‘feeling of presence’ may characterize perceptual mechanisms in the brain. We studied these mechanisms by presenting a VR that consisted of an avatar telling a story about a social conversation. We performed covariance analysis on subjective brain activity (fMRI) during the story presentation with a presence score. The data analysis revealed that activity in several brain areas was correlated with the presence score. A positive correlation was shown in the right lingual gyrus, right cuneus, left lingual gyrus, right fusiform gyrus, left inferior temporal gyrus, anterior cingulate cortex and right posterior cingulate cortex of the brain. This study showed the brain mechanism to be related the feeling of presence and brain activities in our subjects, using VR to communicate information.

참고문헌 (64)

  1. A. Axelsson, "Cubes in the cube: A comparision of collaboration in virtual and real environments", Cyberpsychology and Behavior, 4(2), pp.279~286 (2001)
  2. Addis, D. R, "Characterizing spatial and temporal features of autobiographical memory retrieval networks: a partial least squares approach", Neuroimage, 23(4), pp.1460~1471 (2004)
  3. Astafiev, S. V, "Extrastriate body area in human occipital cortex responds to the performance of motor actions", Nature Neuroscience, 7(5), pp.542~548 (2004)
  4. Barfield, W, "Presence in virtual environments as a function of type of input device and display update rate", Displays, 19(2), pp.91~98 (1998)
  5. Barfield, W, "Visualizing the structure of virtual objects using head tracked stereoscopic displays", the Virtual reality annual international symposium (VRAIS' 97) (1997)
  6. Biocca, F., "The Cyborg's Dilemma: Progressive embodiment in virtual environments", Human factors in information technology, (13), pp.113~144 (1999)
  7. Bronack, S, "Learning in the Zone: A social constructivist framework for distance education in a 3D virtual world", TECHNOLOGY AND TEACHER EDUCATION ANNUAL, (1), pp.268~275 (2006)
  8. Bunge, S. A, "Prefrontal regions involved in keeping information in and out of mind. Brain", 124 (Pt 10), pp.2074~2086 (2001)
  9. Bystrom, K. E, "A conceptual model of the sense of presence in virtual environments", Presence- Teleoperators and Virtual Environments, 8(2), pp.241~244 (1999)
  10. Calarge, C, "Visualizing how one brain understands another: A PET study of theory of mind", American Journal of Psychiatry, 160(11), pp.1954~1964 (2003)
  11. Chan, A. H, "Neural systems for word meaning modulated by semantic ambiguity", Neuroimage, 22(3), pp.1128~1133 (2004)
  12. Cho, B. H, "The effect of virtual reality cognitive training for attention enhancement", Cyberpsychology and Behavior, 5(2), pp.129~137 (2002)
  13. Corbetta, M, "A common network of functional areas for attention and eye movements", Neuron, 21(4), pp.761~773 (1998)
  14. Crosson, B, "Activity in the paracingulate and cingulate sulci during word generation: an fMRI study of functional anatomy", Cereb Cortex, 9(4), pp.307~316 (1999)
  15. Devlin, J. T, "Category-related activation for written words in the posterior fusiform is task specific", Neuropsychologia, 43(1), pp.69~74 (2005)
  16. Dinh, H. Q. W, "Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments", Paper presented at the Proceedings of the IEEE Virtual Reality 1999 Conference, Houston (1999)
  17. Fiez, J. A, "Neuroimaging studies of word reading", Proc Natl Acad Sci U S A, 95(3), pp.914~921 (1998)
  18. Fletcher, P. C, "Other minds in the brain: a functional imaging study of “theory of mind” in story comprehension", Cognition, 57(2), pp.109~128 (1995)
  19. Freeman, J, "Using behavioral realism to estimate presence: A study of the utility of postural responses to motion stimuli", Presence-Teleoperators and Virtual Environments, 9(2), pp.149~164 (2000)
  20. Gardini, S, "Left mediotemporal structures mediate the retrieval of episodic autobiographical mental images", Neuroimage, 30(2), pp.645~655 (2006)
  21. Gardini, S, "Different neuronal pathways support the generation of general and specific mental images", Neuroimage, 27(3), pp.544~552 (2005)
  22. H. Hoffman J. G, "Tactile augmentation: Enhancing presence in virtual reality with tactile feedback from real objects", the Paper presented at the meeting of the American Psychological Society, San Francisco, CA. (1996)
  23. Heeter, C, "Being There: The Subjective Experience of Presence", Presence-Teleoperators and Virtual Environments (1992)
  24. Hendrix, C, "Presence within virtual environments as a function of visual display parameters", Presence-Teleoperators and Virtual Environments, 5(3), pp.274~289 (1996)
  25. Ijsselsteijn, W, "Elements of a multi-level theory of presence: Phenomenology, mental processing and neural correlates", the Proceedings of PRESENCE 2002, Universidade Fernando Pessoa, Porto, Portugal (2002)
  26. J. J-W. Lin, "Effects of field of view on presence, enjoyment, memory and simulator sickness in a virtual environment", the Proceedings of the IEEE Virtual Reality 2002 (VR' 02) (2002)
  27. Jang, D. P, "The development of virtual reality therapy (VRT) system for the treatment of acrophobia and therapeutic case", IEEE Trans Inf Technol Biomed, 6(3), pp.213~217 (2002)
  28. Jurnet, I. A, "Individual Differences in the Sense of Presence", the PRESENCE 2005 (2005)
  29. Kim, J. J, "Direct comparison of the neural substrates of recognition memory for words and faces", Brain, (122), pp.1069~1083 (1999)
  30. Krijn, M, "Treatment of acrophobia in virtual reality: The role of immersion and presence", Behaviour Research and Therapy, 42(2), pp.229~239 (2004)
  31. Ku, J, "A virtual environment for investigating schizophrenic patients characteristics: assessment of cognitive and navigation ability", Cyberpsychology and Behavior, 6(4), pp.397~404 (2003)
  32. Lee, J. H, "A virtual reality system for the assessment and rehabilitation of the activities of daily living", Cyberpsychology and Behavior, 6(4), pp.383~388 (2003)
  33. Lombard, M, "Direct responses to people on the screen: Television and personal space", Communication Research, 22(3), pp.288~324 (1995)
  34. Loomis, J. M, "Distal attribution and presence", Presence-Teleoperators and Virtual Environment, 1(1), pp.113~119 (1992)
  35. Maddock, R. J, "Remembering familiar people: the posterior cingulate cortex and autobiographical memory retrieval", Neuroscience, 104(3), pp.667~676 (2001)
  36. McGreevy, M. W, "The presence of field geologists in Mars-like terrain", Presence- Teleoperators and Virtual Environments, 1(4), pp.375~403 (1992)
  37. Mesulam, M. M, "A cortical network for directed attention and unilateral neglect", Ann Neurol, 10(4), pp.309~325 (1981)
  38. Mesulam, M. M, "From sensation to cognition", Brain, 121(Pt 6), pp.1013~1052 (1998)
  39. Nielsen, F. A, "Mining the posterior cingulate: segregation between memory and pain components", Neuroimage, 27(3), pp.520~532 (2005)
  40. Oman, C. M, "Three dimensional spatial memory and learning in real and virtual environments", Spat Cogn Comput, 2(4), pp.355~372 (2002)
  41. P. Larsson, D. V, "The actor- observer effect in virtual reality presentations", Cyberpsychology and Behavior, 4(2), pp.239~246 (2001)
  42. Pausch, R, "A user study comparing head- mounted and stationary displays", the Proceedings of the IEEE Symposium on Research Frontiers in Virtual Reality, San Jose, CA. (1993)
  43. Phan, K. L, "Functional neuroanatomy of emotion: a meta-analysis of emotion activation studies in PET and fMRI", Neuroimage, 16(2), pp.331~348 (2002)
  44. Widening the field of view increases the sense of presence in inmersive virtual environments, "Prothero, J", Human Interface Technology Lab, ~, pp.Technical Report TR-95-2 (1995)
  45. Richard, E, "Multi-modal virtual environments for education: From illusion to immersion", Technologies for E-Learning and Digital Entertainment, Proceedings, (3942), pp.1274~1279 (2006)
  46. Rizzo, A. A. B., J. G, "The Virtual Classroom: A Virtual Reality Environment for the assessment and Rehabilitation of Attention Deficits", Cyberpsychology and Behavior, 3(3), pp.483~500 (2000)
  47. Rogers, T. T, "Fusiform activation to animals is driven by the process, not the stimulus", Journal of Cognitive Neuroscience, 17(3), pp.434~445 (2005)
  48. Roland, P. E, "Visual Memory, Visual-Imagery, and Visual Recognition of Large Field Patterns by the Human Brain- Functional-Anatomy by Positron Emission Tomography", Cerebral Cortex, 5(1), pp.79~93 (1995)
  49. Rothbaum, B. O, "Effectiveness of computer-generated (virtual reality) graded exposure in the treatment of acrophobia", Am J Psychiatry, 152(4), pp.626~628 (1995)
  50. Russell, G. W, "The Dangerous Edge - the Psychology of Excitement-Apter,Mj", Aggressive Behavior, 20(2), pp.153~155 (1994)
  51. Sanchez-Vives, M. V, "From presence to consciousness through virtual reality", Nat Rev Neurosci, 6(4), pp.332~339 (2005)
  52. Servos, P, "The neural substrates of biological motion perception: An fMRI study", Cerebral Cortex, 12(7), pp.772~782 (2002)
  53. Shirmohammadi, S, "An end-to-end communication architecture for collaborative virtual environments", Computer Networks-the International Journal of Computer and Telecommunications Networking, 35(2-3), pp.351~367 (2001)
  54. Simmons, A, "Affective ambiguity for a group recruits ventromedial prefrontal cortex", Neuroimage, 29(2), pp.655~661 (2006)
  55. Slater, M, "Public speaking in virtual reality: Facing an audience of avatars", Ieee Computer Graphics and Applications, 19(2), pp.6~9 (1999)
  56. Slater, M, "The influence of body movement on subjective presence in virtual environments", Human Factors, 40(3), pp.469~477 (1998)
  57. Slater, M, "Representations systems, perceptual position, and presence in immersive virtual environments", Presence- Teleoperators and Virtual Environment, 2(3), pp.221~233 (1993)
  58. Steuer, J, "Defining Virtual Reality: Dimensions Determining Telepresence", JOURNAL OF COMMUNICATION, 42(4), pp.73~93 (1992)
  59. Västfjäll, D, "The subjective sense of presence, emotion recognition, and experienced emotions in auditory virtual environments", Cyberpsychology and Behavior, 6(2), pp.181~188 (2003)
  60. Vidal, M, "Navigating in a virtual three-dimensional maze: how do egocentric and allocentric reference frames interact?", Brain Res Cogn Brain Res, 19(3), pp.244~258 (2004)
  61. W. Ijsselsteijn H. d. R, "Effects of stereoscopic presentation, image motion, and screen size on subjective and objective corroborative measures of presence", Presence-Teleoperators and Virtual Environments, 10(3), pp.298~311 (2001)
  62. Welch, R. B, "The effects of pictorial realism, delay of visual feedback, and observer interactivity an the subjective sense of presence", Presence-Teleoperators and Virtual Environments, 5(3), pp.263~273 (1996)
  63. Wiederhold, B. K, "The treatment of fear of flying: a controlled study of imaginal and virtual reality graded exposure therapy", IEEE Trans Inf Technol Biomed, 6(3), pp.218~223 (2002)
  64. Witmer, B. G, "Measuring presence in virtual environments: A presence questionnaire", Presence-Teleoperators and Virtual Environments, 7(3), pp.225~240 (1998)

관련 논문AI추천

가상현실을 통한 정보 전달 시 존재감과 뇌 활성화의 관계김광욱, 김선일, 김소영, 김인영, 김재진, 김찬형, 남상원, 남종호, 박진식, 윤강준, 이형래, 한기완예술과 과학기술연구소 · 예술과 과학기술2006 · 제2권 제1호조현병 환자에서 다감각적 되먹임에 의한 원격현존감 특성 및 관련 신경 기전 : 기능자기공명영상 연구김선일, 김재진, 박일호, 이형래, 최수희, 환기완대한생물정신의학회 · 생물정신의학2012 · 제19권 제3호정신분열병 환자에서 가상현실을 이용한 추론과제 수행 중 활성화된 뇌영역과 현존감과의 관계：기능자기공명영상 연구구정훈, 김선일, 김소영, 김인영, 김재진, 박일호, 윤강준, 이형래, 최수희대한신경정신의학회 · 신경정신의학2008 · 제47권 제3호가상공간의 수업유형에 따른 아바타의 실제얼굴제시 여부가 사회적 실재감, 주의집중, 시선응시에 미치는 영향김국현, 류지헌한국교육정보미디어학회 · 교육정보미디어연구2023 · 제29권 제4호가상 아바타와의 전신 몸 소유감에서 시각-운동 및 시각-촉각 동기화에 관한 연구김광욱, 김지환, 오진택(사)한국컴퓨터그래픽스학회 · 한국컴퓨터그래픽스학회논문지2022 · 제28권 제3호가상현실의 아바타를 통한 실재감에 대한 사용자의 반응 연구-3D웹 가상공간의 아바타 사용자 중에서 청소년을 대상으로-이향재한국디자인트렌드학회 · 한국디자인포럼2006 · 제13호

이 간행물의 다른 논문 (7건)

신문기사의 언어 사용 양상: 코퍼스언어학적 접근강범모, 송경화pp. 255-269자동문제생성기술을 이용한 한국어 어휘학습시스템옥철영, 최수일, 임지희, 최호섭pp. 271-286배경깊이정보가 이차원 자극의 형태 판단에 미치는 영향신현정, 김영근pp. 287-301직관실험 및 코퍼스를 바탕으로 한 의미 중의성 해소 계산 모형 연구김동성, 최재웅pp. 303-321정렬된 성경 코퍼스로부터 바꿔쓰기표현(paraphrase)의 자동 추출이공주, 윤보현pp. 323-336
원문 보기