잡음 제거 기술 기반의 비디오 인페인팅 성능 연구
A Study on the Video Inpainting Performance using Denoising Technique
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
In this paper, we study the effect of noise on video inpainting, a technique that fills missing regions of video. Since the video may contain noise, the quality of the video may be affected when applying the video inpainting technique. Therefore, in this paper, we compare the inpainting performance in video with and without denoising techniqueDAVIS dataset. For that, we conducted two experiments: 1) applying inpainting technique after denoising the noisy video and 2) applying the inpainting technique to the video and denoising the video. Through the experiment, we observe the effect of denoising technique on the quality of video inpainting and conclude that video inpainting after denoising would improve the quality of the video subjectively and objectively.
Abstract
In this paper, we study the effect of noise on video inpainting, a technique that fills missing regions of video. Since the video may contain noise, the quality of the video may be affected when applying the video inpainting technique. Therefore, in this paper, we compare the inpainting performance in video with and without denoising techniqueDAVIS dataset. For that, we conducted two experiments: 1) applying inpainting technique after denoising the noisy video and 2) applying the inpainting technique to the video and denoising the video. Through the experiment, we observe the effect of denoising technique on the quality of video inpainting and conclude that video inpainting after denoising would improve the quality of the video subjectively and objectively.
참고문헌 (15)
- M. Bertalmio, "Simultaneous Structure and Texture Image Inpainting", IEEE Transactions on Image Processing, 12(8), pp.882~889 (2003)
- S. Darabi, "Image Modeling : Combining Inconsistent Images Using Patch-based Synthesis", ACM Transactions on Graphics, 31(4), pp.1~10 (2012)
- M. Bertalmio, "Image Inpainting", Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp.417~424 (2000)
- C. Ballester, "Filling-in by Joint Interpolation of Vector Fields and Gray Levels", IEEE Transactions on Image Processing, 10(8), pp.1200~1211 (2001)
- G. Liu, "Image Inpainting for Irregular Holes Using Partial Convolutions", Proceedings of the European Conference on Computer Vision, pp.85~100 (2018)
- J. Yu, "Free-form Image Inpainting with Gated Convolution", Proceedings of IEEE, 2019, 4470~4479
- S. Iizuka, "Globally and Locally Consistent Image Completion", ACM Transactions on Graphics, 36(4), pp.1~14 (2017)
- J. Yu, "Generative Image Inpainting with Contextual Attention", Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp.5505~5514 (2018)
- I. Goodfellow, "Generative Adversarial Nets", Advances in Neural Information Processing Systems, pp.2672~2680 (2014)
- R. Xu, "Deep Flow-guided Video Inpainting", Proceedings of the IEEE, 2017, 3718~3727
- D. Kim, "Deep Video Inpainting", Proceedings of the IEEE, 2019, 5792~5801
- E. Ilg, "Flownet 2.0: Evolution of Optical Flow Estimation with Deep Networks", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.2462~2470 (2017)
- T. W. Hui, "LiteFlowNet: A Lightweight Convolutional Neural Network for Optical Flow Estmation", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.8981~8989 (2018)
- M. Tassano, "FastDVDnet: Towards Real-time Deep Video Denoising Without Flow Estimation", Proceedings of IEEE, 2020, 1351~1360
- F. Perazzi, "A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.724~732 (2016)