Image Restoration and Object Removal Using Prioritized Adaptive Patch-Based Inpainting in a Wavelet Domain
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Image restoration has been carried out by texture synthesis mostly for large regions and inpainting algorithmsfor small cracks in images. In this paper, we propose a new approach that allows for the simultaneous fill-inof different structures and textures by processing in a wavelet domain. A combination of structure inpaintingand patch-based texture synthesis is carried out, which is known as patch-based inpainting, for filling andupdating the target region. The wavelet transform is used for its very good multiresolution capabilities. Theproposed algorithm uses the wavelet domain subbands to resolve the structure and texture components insmooth approximation and high frequency structural details. The subbands are processed separately by theprioritized patch-based inpainting with isophote energy driven texture synthesis at the core. The algorithmautomatically estimates the wavelet coefficients of the target regions of various subbands using optimizedpatches from the surrounding DWT coefficients. The suggested performance improvement drasticallyimproves execution speed over the existing algorithm. The proposed patch optimization strategy improves thequality of the fill. The fill-in is done with higher priority to structures and isophotes arriving at targetboundaries. The effectiveness of the algorithm is demonstrated with natural and textured images with varyingtextural complexions.
Abstract
Image restoration has been carried out by texture synthesis mostly for large regions and inpainting algorithmsfor small cracks in images. In this paper, we propose a new approach that allows for the simultaneous fill-inof different structures and textures by processing in a wavelet domain. A combination of structure inpaintingand patch-based texture synthesis is carried out, which is known as patch-based inpainting, for filling andupdating the target region. The wavelet transform is used for its very good multiresolution capabilities. Theproposed algorithm uses the wavelet domain subbands to resolve the structure and texture components insmooth approximation and high frequency structural details. The subbands are processed separately by theprioritized patch-based inpainting with isophote energy driven texture synthesis at the core. The algorithmautomatically estimates the wavelet coefficients of the target regions of various subbands using optimizedpatches from the surrounding DWT coefficients. The suggested performance improvement drasticallyimproves execution speed over the existing algorithm. The proposed patch optimization strategy improves thequality of the fill. The fill-in is done with higher priority to structures and isophotes arriving at targetboundaries. The effectiveness of the algorithm is demonstrated with natural and textured images with varyingtextural complexions.
참고문헌 (39)
- M. Bertalmio, "Image inpainting", Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’00), pp.417~424 (2000)
- C. Ballester, "A variational model for filling-in gray level and color images", Proceedings of 8th IEEE International Conference on Computer Vision (ICCV2001), pp.10~16 (2001)
- T. F. Chan, "Nontexture inpainting by curvature-driven diffusions", Journal of Visual Communication and Image Representation, 12(4), pp.436~449 (2001)
- G. Kanizsa, "Organization in Vision: Essays on Gestalt Perception" (1979), Praeger
- L. Pessoa, "Finding out about filling-in : a guide to perceptual completion for visual science and the philosophy of perception", Behavioral and Brain Sciences, 24(6), pp.723~802 (1998)
- S. Sarkar, "Integration, inference, and management of spatial information using Bayesian networks : perceptual organization", IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(3), pp.256~274 (1993)
- D. Tschumperle, "Vector valued image regularization with PDEs : a common framework for different applications", IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(4), pp.506~517 (2005)
- S. Masnou, "Level lines based disocclusion", Proceeding of International Conference on Image Processing (ICIP 98), pp.259~263 (1998)
- A. C. Kokaram, "Interpolation of missing data in image sequences", IEEE Transactions on Image Processing, 4(11), pp.1509~1519 (1995)
- M. Bertalmio, "Simultaneous structure and texture image inpainting", Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR2003), pp.707~712 (2003)
- I. Drori, "Fragment based image completion", ACM Transactions on Graphics, 22(3), pp.303~312 (2003)
- P. Harrison, "A non-hierarchical procedure for re-synthesis of complex texture", Proceeding of the 9th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG2001), pp.190~197 (2001)
- R. Bornard, "Missing data correction in still images and image sequences", Proceedings of the 10th ACM International Conference on Multimedia, pp.355~361 (2002)
- J. S. De Bonet, "Multiresolution sampling procedure for analysis and synthesis of texture images", Proceedings of 24th annual ACM Conference Computer Graphics and Interactive Techniques (SIGGRAPH), pp.361~368 (1997)
- D. Garber, "Computational models for texture analysis and texture synthesis", Ph.D, pp.1981
- D. J. Heeger, "Pyramid based texture analysis", synthesis, 1995, 229~238
- A. A. Efros, "Image quilting for texture synthesis and transfer", Proceeding of the 28th ACM Annual Conference on Computer Graphics, pp.341~346 (2001)
- L. Liang, "Real-time texture synthesis by patch based sampling", ACM Transactions on Graphics, 20(3), pp.127~150 (2001)
- M. Ashikhmin, "Synthesizing natural textures", Proceedings of the 2001 Symposium on Interactive 3D Graphics, pp.217~226 (2001)
- J. Wu, "Object removal by cross isophotes exemplar based inpainting", Proceeding of 18th International Conference on Pattern Recognition (ICPR2006), pp.810~813 (2006)
- A. Criminisi, "Region filling and object removal by exemplar based image inpainting", IEEE Transactions on Image Processing, 13(9), pp.1200~1212 (2004)
- Y. Chen, "Sketch guided texture based image inpainting", Proceeding of IEEE International Conference on Image Processing (ICIP), pp.1997~2000 (2006)
- J. Sun, "Image compilation with structure propagation", ACM Transactions on Graphics, 24(3), pp.861~868 (2005)
- T. F. Chan, "Total variation wavelet inpainting", Journal of Mathematical Imaging and Vision, 25(1), pp.107~125 (2006)
- S. D. Rane, "Wavelet domain reconstruction of lost blocks in wireless image transmission and packet switched networks", Proceedings of IEEE International Conference on Image Processing (ICIP), pp.309~312 (2002)
- K. Patwardhan, "Projection based image and video inpainting using wavelets", Proceedings of IEEE International Conference on Image Processing (ICIP), pp.857~860 (2003)
- D. Cho, "Image inpainting using wavelet based inter- and intra-scale dependency", Proceedings of 19th International Conference on Pattern Recognition (ICPR), pp.1~4 (2008)
- G. Hua, "Image inpainting based on geometrical modeling of complexwavelet coefficients", Proceeding of IEEE International Conference on Image Processing (ICIP), pp.553~556 (2007)
- F. Wang, "An new method for image inpainting using wavelets", Proceeding of International Conference on Multimedia Technology (ICMT), pp.201~204 (2011)
- Y. W. Wen, "A primal–dual method for total-variation-based wavelet domain inpainting", IEEE Transactions on Image Processing, 21(1), pp.106~114 (2012)
- L. Chen, "Blind image restoration using divisional regularization and wavelet technique", Proceeding of 4th International Conference on Natural Computation (ICNC'08), pp.476~480 (2008)
- R. H. Chan, "A fast optimization transfer algorithm for image inpainting in wavelet domains", IEEE Transactions on Image Processing, 18(7), pp.1467~1476 (2009)
- J. C. Hung, "Exemplar-based image inpainting base on structure construction", Journal of Software, 3(8), pp.57~64 (2008)
- R. P. Borole, "Image analysis & restoration by exemplar inpainting", Proceedings of National Conference on Communication, Computing and Networking (NCCCNT’13) (2013)
- R. P. Borole, "Patch-based inpainting for object removal and region filling in images", Journal of Intelligent Systems, 22(3), pp.335~350 (2013)
- R. C. Gonzalez, "Digital Image Processing" (2002), Prentice Hall
- S. G. Mallat, "A theory for multiresolution signal decomposition : the wavelet representation", IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(7), pp.674~693 (1989)
- A. Efros, "Texture synthesis by non-parametric sampling", Proceeding of the 7th IEEE International Conference on Computer Vision, pp.1033~1038 (1999)
- D. Sun, "Structure-aware image completion with texture propagation", Proceeding of 6th International Conference on Image and Graphics (ICIG), pp.199~204 (2011)