비지도 학습 기반 영상 노이즈 제거 기술을 위한 정규화 기법의 최적화
Optimized Normalization for Unsupervised Learning-based Image Denoising
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
최근 노이즈 제거를 위한 심층 학습 모델에 대한 연구가 활발하게 진행되고 있다. 특히 블라인드 노이즈 제거 (blind denoising) 기술이 발전하면서 깨끗한 영상을 얻기가 불가능한 영상의 영역에서 노이즈 영상만으로 심층 학습 기반 노이즈 제거 모델의 학습이 가능해졌다. 우리는 관찰된 노이즈 영상으로부터 깨끗한 영상을 얻기 위해 더는 깨끗한 영상과 노이즈 영상의 짝을이루는 데이터를 필요하지 않는다. 하지만 노이즈 영상과 깨끗한 영상 간의 차이가 큰 데이터라면 노이즈 영상만으로 학습된노이즈 제거 모델은 우리가 원하는 품질의 깨끗한 영상을 복원하기 어려울 것이다. 이 문제를 해결하기 위해서 짝지어지지않는 깨끗한 영상과 노이즈 영상으로 학습한 모델 기반 노이즈 제거 기술은 최근 연구되고 있다. 가장 최신 기술인 ISCL은깨끗한 영상과 노이즈 영상의 쌍을 기반으로 한 지도학습 기반 모델의 성능과 거의 근접한 성능을 보여 주었다. 우리는 제안된방법이 ISCL을 포함한 다른 최신 짝을 이루지 않는 영상 기반 노이즈 제거 기술보다 성능이 우수함을 보여준다.
Abstract
Recently, deep learning-based denoising approaches have been actively studied. In particular, with the advances of blind denoising techniques, it become possible to train a deep learning-based denoising model only with noisy images in an image domain where it is impossible to obtain a clean image. We no longer require pairs of a clean image and a noisy image to obtain a restored clean image from the observation. However, it is difficult to recover the target using a deep learning-based denoising model trained by only noisy images if the distribution of the noisy image is far from the distribution of the clean image. To address this limitation, unpaired image denoising approaches have recently been studied that can learn the denoising model from unpaired data of the noisy image and the clean image. ISCL showed comparable performance close to that of supervised learning-based models based on pairs of clean and noisy images. In this study, we propose suitable normalization techniques for each purpose of architectures (e.g., generator, discriminator, and extractor) of ISCL. We demonstrate that the proposed method outperforms state-of-the-art unpaired image denoising approaches including ISCL.
참고문헌 (29)
- Kanggeun Lee, "ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising", IEEE Transactions on Medical Imaging, 40(11), pp.3238~3248 (2021), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- D. G. C. Hildebrand, "Gridtape for fast nanoscale imaging", ~ (2017)
- B. J. Graham, "Gridtape imaging stage", ~ (2018)
- "High-throughput transmission electron microscopy with automated serial sectioning" (2019)[URL]
- T. Minh Quan, "Removing imaging artifacts in electron microscopy using an asymmetrically cyclic adversarial network without paired training data", Proc. IEEE Int. Conf. Comput. Vis. Workshop (2019)
- K. Zhang, "Beyond a gaussian denoiser : Residual learning of deep cnn for image denoising", IEEE Trans. Image Process., 26(7), pp.3142~3155 (2017)
- Z. Huang, "Cagan : a cycleconsistent generative adversarial network with attention for low-dose ct imaging", IEEE Trans. Comput. Imag., 6, pp.1203~1218 (2020)
- D. Bashkirova, "Adversarial selfdefense for cycle-consistent gans", Proc. Adv. Neural Inf. Process. Syst, 32 (2019)
- J. -Y. Zhu, "Unpaired imageto-image translation using cycle-consistent adversarial networks", Proc. IEEE Int. Conf. Comput. Vis., pp.2223~2232 (2017)
- K. Dabov, "Image denoising by sparse 3-d transform-domain collaborative filtering", IEEE Trans. Image Process., 16(8), pp.2080~2095 (2007)
- S. Ioffe, "Batch normalization: Accelerating deep network training by reducing internal covariate shift", Proc. Int. Conf. Mach. Learn., 37, pp.448~456 (2015)
- J. Lehtinen, "Noise2Noise: Learning image restoration without clean data", Proc. Int. Conf. Mach. Learn., 80, pp.2965~2974 (2018)
- "Noise2kernel: Adaptive self-supervised blind denoising using a dilated convolutional kernel architecture" (2020)[URL]
- A. Krull, "Noise2void-learning denoising from single noisy images", Proc. IEEE conf. Comput. Vis. Pattern Recognit, pp.2129~2137 (2019)
- J. Batson, "Noise2Self: Blind denoising by selfsupervision", Proc. Int. Conf. Mach. Learn., pp.524~533 (2019)
- Y. Quan, "Self2Self with dropout: Learning self-supervised denoising from single image", Proc. IEEE conf. Comput. Vis. Pattern Recognit., pp.1890~1898 (2020)
- H. Liao, "Adn : Artifact disentanglement network for unsupervised metal artifact reduction", IEEE Trans. Med. Imag., 39(3), pp.634~643 (2019)
- Y. Huang, "Noise-powered disentangled representation for unsupervised speckle reduction of optical coherence tomography images", IEEE Trans. Med. Imag. (2020)
- H. Nam, "Batch-instance normalization for adaptively style-invariant neural networks", Proc. Adv. Neural Inf. Process. Syst, 31, pp.2558~2567 (2018)
- "Instance normalization: The missing ingredient for fast stylization" (2016)[URL]
- P. Luo, "Switchable normalization for learning-to-normalize deep representation", IEEE Trans. Pattern Anal. Mach. Intell., 43(2), pp.712~728 (2019)
- "Layer normalization" (2016)[URL]
- T. Miyato, "Spectral normalization for generative adversarial networks", Proc. Int. Conf. Learn. Represent (2018)
- A. Brock, "Large scale gan training for high fidelity natural image synthesis", Proc. Int. Conf. Learn. Represent (2018)
- M. Arjovsky, "Wasserstein generative adversarial networks", Proc. Int. Conf. Mach. Learn, 70, pp.214~223 (2017)
- I. Gulrajani, "Improved training of wasserstein gans", Proc. Adv. Neural Inf. Process. Syst, pp.5767~5777 (2017)
- H. Chen, "Low-dose ct with a residual encoderdecoder convolutional neural network", IEEE Trans. Med. Imag., 36(12), pp.2524~2535 (2017)
- Z. Hong, "End-to-end unpaired image denoising with conditional adversarial networks", Proc. Assoc. Adv. Artific. Intell, pp.4140~4149 (2020)
- Y. Wu, "Group normalization", Eur. Conf. Comput. Vis, pp.3~19 (2018)