레이트레이싱 기반 회절을 이용한 가상 환경에서의 효율적인 사운드 제어 기법
Efficient Sound Control Method in Virtual Environments Using Raytracing Based Diffraction
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
본 논문에서는 가상환경에서 사운드 몰입을 개선시키기 위한 회절 기반의 사운드 제어 기법을제안한다. 제안하는 기법은 물리적 환경에서 사운드의 파동과 흐름 그리고 회절과 유사한 패턴을실시간으로 표현할 수 있다. 우리의 접근 방식은 사운드 근원지로부터 장애물이 있는지 판단을한 뒤, 장애물로 인해 굴절과 회절된 새로운 사운드의 위치를 계산한다. 레이트레이싱 기반으로장애물과의 충돌 여부를 판단하고, 충돌에 의해 반사와 굴절된 벡터를 이용하여 장애물 너머에있는 에이전트에게 들리는 사운드의 크기를 예측한다. 이 과정에서 반사와 굴절된 레이의 개수에따라 사운드의 크기를 감쇠시켜 거리와 재질에 따른 사운드 감쇠를 모델링한다. 결과적으로 물리기반 접근법에서 표현되는 회절 패턴을 실시간으로 표현했으며, 장애물의 위치가 변경됨에 따라회절 패턴도 변경됨을 보여주고, 이에 따라 사운드의 크기가 자연스럽게 확산되는 결과를 보여준다. 제안하는 방법은 현실에서 표현되는 소리의 확산과 회절 특징을 거의 유사하게 복원해냈다.
Abstract
In this paper, we propose diffraction-based sound control method to improve sound immersion in a virtual environment. The proposed technique can express the wave and flow of sound in a physical environment and a pattern similar to diffraction in real-time. Our approach determines whether there is an obstacle from the location of the sound source and then calculates the position of the new sound reflected and diffracted by the obstacle. Based on ray tracing, it determines whether or not it collides with an obstacle, and predicts the sound level of the agent behind the obstacle by using the vector reflected and refraction by the collision. In this process, the sound attenuation according to the distance/material is modeled by attenuating the size of the sound according to the number of reflected/refracted rays. As a result, the diffraction pattern expressed in the physics-based approach was expressed in real time, and it shows that the diffraction pattern also changes as the position of the obstacle is changed, thereby showing the result of naturally spreading the size of the sound. The proposed method restores the diffusion and diffraction characteristics of sound expressed in real life almost similarly.
참고문헌 (15)
- Wang, "Physically based modeling in virtual assembly", International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, pp.295~305 (2001)
- Gugenheimer, Jan, "Sharevr: Enabling co-located experiences for virtual reality between hmd and non-hmd users", Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp.4021~4033 (2017)
- Van Den Doel, Kees, "oleyAutomatic: physically-based sound effects for interactive simulation and animation", Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pp.537~544 (2001)
- De Poli, G, "Physically based sound modelling", Organised Sound, 3(1), pp.61~76 (2001)[DOI]
- Schröder, Dirk, "Physically based real-time auralization of interactive virtual environments Vol. 11" (2011), Logos Verlag Berlin GmbH
- Breebaart, "Multi-channel goes mobile: MPEG Surround binaural rendering", Audio Engineering Society Conference: 29th International Conference: Audio for Mobile and Handheld Devices (2006), Audio Engineering Society
- Kim, Kwangki, "A study on complexity reduction of binaural decoding in multi-channel audio coding for realistic audio service", ~ (2015)
- Kim, Kwangki, "Sound scene control of multi-channel audio signals for realistic audio service in wired", wireless network, 2014, pp.9(2), 253~258
- Nagao, Katashi, "Building-scale virtual reality: reconstruction and modification of building interior extends real world", International Journal of Multimedia Data Engineering and Management, 10, pp.1~21 (2019)
- Połap, Dawid, "Obstacle detection as a safety alert in augmented reality models by the use of deep learning techniques", Sensors, 17(12) (2017)[DOI]
- Fujisaki, Waka, "Audiovisual integration in the human perception of materials", Journal of Vision, 14(4), pp.12~ (2014)[DOI]
- Kern, Angelika C, "Audio in VR:effects of a soundscape and movement-triggered step sounds on presence", Frontiers in Robotics and AI, 7, pp.20~ (2020)[DOI]
- Lahav, Orly, "Multisensory virtual environment for supporting blind persons' acquisition of spatial cognitive mapping–a case study", EdMedia+ Innovate Learning, pp.1046~1051 (2001), Association for the Advancement of Computing in Education
- Inman, Dean P, "Teaching orientation and mobility skills to blind children using computer generated 3D sound environments", Georgia Institute of Technology (2000)
- Siu, Alexa F, "Virtual reality without vision: A haptic and auditory white cane to navigate complex virtual worlds", Proceedings of the 2020 CHI conference on human factors in computing systems, pp.1~13 (2020)