Real-Time 2D-to-3D Conversion for 3DTV using Time-Coherent Depth-Map Generation Method
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Depth-image-based rendering is generally used in real-time 2D-to-3D conversion for 3DTV. However, inaccurate depth maps cause flickering issues between image frames in a video sequence, resulting in eye fatigue while viewing 3DTV. To resolve this flickering issue, we propose a new 2D-to-3D conversion scheme based on fast and robust depth-map generation from a 2D video sequence. The proposed depth-map generation algorithm divides an input video sequence into several cuts using a color histogram. The initial depth of each cut is assigned based on a hypothesized depth-gradient model. The initial depth map of the current frame is refined using color and motion information. Thereafter, the depth map of the next frame is updated using the difference image to reduce depth flickering. The experimental results confirm that the proposed scheme performs real-time 2D-to-3D conversions effectively and reduces human eye fatigue.
Abstract
Depth-image-based rendering is generally used in real-time 2D-to-3D conversion for 3DTV. However, inaccurate depth maps cause flickering issues between image frames in a video sequence, resulting in eye fatigue while viewing 3DTV. To resolve this flickering issue, we propose a new 2D-to-3D conversion scheme based on fast and robust depth-map generation from a 2D video sequence. The proposed depth-map generation algorithm divides an input video sequence into several cuts using a color histogram. The initial depth of each cut is assigned based on a hypothesized depth-gradient model. The initial depth map of the current frame is refined using color and motion information. Thereafter, the depth map of the next frame is updated using the difference image to reduce depth flickering. The experimental results confirm that the proposed scheme performs real-time 2D-to-3D conversions effectively and reduces human eye fatigue.
참고문헌 (21)
- 박종일, "Virtual Control of Optical Axis of the 3DTV Camera for Reducing Visual Fatigue in Stereoscopic 3DTV", ETRI Journal, 26(6), pp.597~604 (2004), 한국전자통신연구원
- S-Y. Kim, "Three Dimensional Natural Video System Based on Layered Representation of Depth Maps", IEEE Trans. Consumer Electronics, 52(3), pp.1035~1042 (2006)
- L. Zhang, "Stereoscopic Image Generation Based on Depth Images for 3D TV", IEEE Trans. Broadcasting, 51(2), pp.191~199 (2005)
- P. Harman, "Rapid 2D to 3D conversion", Proc. SPIE, 4660, pp.78~86 (2002)
- X. Ashutosh, "Make 3D:Learning 3D Scene Structure from A Single Still Image", IEEE Trans. Pattern Analysis and Machine Intelligence, 31(5), pp.824~840 (2009)
- C.-C. Cheng, "A Novel 2D-to-3D Conversion System Using Edge Information", IEEE Trans. Consumer Electronics, 56(3), pp.1739~1745 (2010)
- F. Yu, "Depth generation method for 2D to 3D conversion", Proc. IEEE 3DTV Conference, pp.1~4 (2011)
- D. Kim, "Stereoscopic Video Generation Method Using Stereoscopic Display Characterization and Motion Analysis", IEEE Trans. Broadcasting, 54(2), pp.188~197 (2008)
- C.-C. Cheng, "A Block-based 2D to 3D conversion system with bilateral filter", Proc. IEEE International Conference on Consumer Electronics, pp.1~2 (2009)
- S. H. Lai, "A Generalized Depth Estimation Algorithm with A Single Image", IEEE Trans. on Pattern Analysis and Machine Intelligence, 14(4), pp.405~411 (1992)
- G. Gau, "2D to 3D conversion based on edge defocus and segmentation", Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, pp.2181~2184 (2008)
- S. -F. Tsai, "A Real-time 1080p 2D-to-3D Video Conversion System", IEEE Trans. Consumer Electronics, 57(2), pp.915~922 (2011)
- Z. Zhang, "Visual pertinent 2D-to-3D video conversion", Proc. IEEE International Conference on Image Processing, pp.909~912 (2011)
- L. -M. Po, "Automatic 2D-to-3D video conversion technique based on depth-from-motion and color segmentation", Proc. IEEE International Conference on Signal Processing, pp.1000~1003 (2010)
- Y. -L. Chang, "Priority depth fusion for the 2D-to-3D conversion system", Proc. SPIE, 6805 (2008)
- S.-W. Nam, "Realtime 2D to 3D conversion for 3DTV using time coherent depth map generation method", Proc. IEEE International Conference on Consumer Electronics, pp.187~188 (2013)
- I. Ideses, "Real-time 2D to 3D Video Conversion", Journal of Real-time Image Processing, 2(1), pp.3~9 (2007)
- C. Tomasi, "Bilateral filtering for gray and color images", Proc. IEEE International Conference on Computer Vision, pp.839~846 (1998)
- J. Mas, "Video shot boundary detection based on color histogram", Proc. TREC Video Retrieval Evaluation Conference (2003)
- R. Adams, "Seeded Region Growing", IEEE Trans. Pattern Analysis and Machine Intelligence, 16(6), pp.641~647 (1994)
- T. Shibata, "The Zone of Comfort: Predicting Visual Discomfort With Stereo Displays", Journal of Vision, 11(8), pp.1~29 (2011)