A Study on Sound Scene Control of Binaural Sound in Multi-channel Audio Coding
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Recently, realistic visual services such as 3DTV, UHDTV, 3D cinema, 3D gaming, augmented reality (AR), virtual reality (VR) and so on are introduced, and realistic audio services are getting more important to make the realistic visual services more realistic. Generally, the realistic audio services have a limitation that users should have multi-channel speaker layout for generating the realistic audio sound, so the binaural sound generation method that provides the users the realistic sound through a stereo headphone has been introduced. But, since the binaural sound has a constant sound scene, it can not reflect the users’ movement in the AR or the VR service. In this paper, we proposed a sound scene control scheme of binaural sound in the multi-channel audio coding for generating a more realistic audio sound in the VR or AR service. In the proposed method, multi-channel gain factors and a stereo down-mix signal are modified based on the new multi-channel layout to be arranged according to a user’s head movement. The experimental results show that the proposed sound scene control scheme of the binaural sound in the multi-channel audio coding can successfully generate the binaural sound with the controlled sound scene while maintaining the good sound quality.
Abstract
Recently, realistic visual services such as 3DTV, UHDTV, 3D cinema, 3D gaming, augmented reality (AR), virtual reality (VR) and so on are introduced, and realistic audio services are getting more important to make the realistic visual services more realistic. Generally, the realistic audio services have a limitation that users should have multi-channel speaker layout for generating the realistic audio sound, so the binaural sound generation method that provides the users the realistic sound through a stereo headphone has been introduced. But, since the binaural sound has a constant sound scene, it can not reflect the users’ movement in the AR or the VR service. In this paper, we proposed a sound scene control scheme of binaural sound in the multi-channel audio coding for generating a more realistic audio sound in the VR or AR service. In the proposed method, multi-channel gain factors and a stereo down-mix signal are modified based on the new multi-channel layout to be arranged according to a user’s head movement. The experimental results show that the proposed sound scene control scheme of the binaural sound in the multi-channel audio coding can successfully generate the binaural sound with the controlled sound scene while maintaining the good sound quality.
참고문헌 (15)
- I-J. Kim, "Trends on virtual reality technology", Broadcastings and Media, 22(2), pp.51~60 (2016)
- Y-M. Im, "Contents and trends for virtual reality technology", Journal of the Korean Institute of Communications and Information Sciences, 33(12), pp.49~55 (2016)
- K-K. Kim, "Binaural decoding for efficient multi-channel audio service in network environment", 2014 IEEE 11th Consumer Communications and Networking Conference, pp.525~526 (2014)
- K-K. Kim, "A study on complexity reduction of binaural decoding in multi-channel audio coding for realistic audio service", Contemporary Engineering Sciences, 9(1), pp.11~19 (2016)
- "ISO", IEC 23003-1, Information Technology– MPEG Audio Technologies – Part 1: MPEG Surround, 2007
- C. Faller, "Binaural cue coding-Part II: Schemes and applications", IEEE Trans. Speech Audio Processing, 11, pp.520~531 (2003)
- F. Baumgarte, "Binaural cue coding-part I: psychoacoustic fundamentals and design principles", IEEE Transactions on Speech and Audio Processing, 11(6), pp.509~519 (2003)
- H. Moon, "A multi-channel audio compression method with virtual source location information for MPEG-4 SAC", Consumer Electronics, IEEE Transactions, 51(4), pp.1253~1259 (2005)
- 백승권, "Angle-Based Virtual Source Location Representation for Spatial Audio Coding", ETRI Journal, 28(2), pp.219~222 (2006), 한국전자통신연구원
- K. Kim, "Spatial audio object coding with two-step coding structure for interactive audio service", IEEE Trans. on Multimedia, 13(6), pp.1208~1216 (2011)
- 김광기, "Improved Channel Level Difference Quantization for Spatial Audio Coding", ETRI Journal, 29(1), pp.99~102 (2007), 한국전자통신연구원
- K-K. Kim, "Sound scene control of multi-channel audio signals for realistic audio service in wired", wireless network, 2014, pp.9(2), 253~258
- V. Pulkki, "Virtual sound source positioning using vector base amplitude panning", Journal of Audio Engineering Society, 45, pp.456~466 (1997)
- "ISO", IEC JTC1, WG11 (MPEG), Procedures for the evaluation of spatial audio coding systems, Document N6691, 2004[DOI]
- "ITU-R Recommendation, Method for the subjective assessment of intermediate sound quality (MUSHRA), ITU, BS", 1543~1541 (2001)