상호증류를 통한 SRGAN 판별자의 성능 개선
Performance Improvement of SRGAN’s Discriminator via Mutual Distillation
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
상호증류는 교사 네트워크 도움 없이 다수의 네트워크 사이에 지식을 전달함으로써 협력적으로 학습하도록 유도하는 지식증류 방법이다. 본 논문은 상호증류가 초해상화 네트워크에도 적용 가능한지 확인하는 것을 목표로 한다. 이를 위해 상호증류를 SRGAN의 판별자에 적용하는 실험을 수행하고, 상호증류가 SRGAN의 성능 향상에 미치는 영향을 분석한다. 실험 결과, 상호증류를 통해 판별자의 지식을 공유한 SRGAN은 정량적, 정성적 화질이 개선된 초해상화 영상을 생성하였다.
Abstract
Mutual distillation is a knowledge distillation method that guides a cohort of neural networks to learn cooperatively by transferring knowledge between them, without the help of a teacher network. This paper aims to confirm whether mutual distillation is also applicable to super-resolution networks. To this regard, we conduct experiments to apply mutual distillation to the discriminators of SRGANs and analyze the effect of mutual distillation on improving SRGAN’s performance. As a result of the experiment, it was confirmed that SRGANs whose discriminators shared their knowledge through mutual distillation can produce super-resolution images enhanced in both quantitative and qualitative qualities.
참고문헌 (19)
- C. Ledig, "Photo-realistic single image superresolution using a generative adversarial network", Proc. of CVPR, pp.105~114 (2017)
- G. Hinton, "Distilling the knowledge in a neural network", Proc. of NIPS (2014)
- Y. Zhang, "Deep mutual learning", Proc. of CVPR, pp.4320~4328 (2018)
- A. Romero, "FitNets: hints for thin deep nets", Proc. of ICLR (2015)
- N. Komodakis, "Paying more attention to attention: improving the performance of convolutional neural networks via attention transfer", Proc. of ICLR (2017)
- L. Zhang, "Be your own teacher: improve the performance of convolutional neural networks via self distillation", Proc. of ICCV, pp.3713~3722 (2019)
- Z. He, "Fakd: feature-affinity based knowledge distillation for efficient image super-resolution", Proc. of ICIP, pp.518~522 (2020)
- C. Dong, "Image super-resolution using deep convolutional networks", Proc. of ECCV, pp.184~199 (2014)
- I. J. Goodfellow, "Generative adversarial networks", ~ (2014)
- K. Simonyan, "Very deep convolutional networks for large-scale image recognition", ~ (2014)
- X. Wang, "ESRGAN: enhanced super resolution generative adversarial networks", Proc. of ECCV, pp.63~79 (2018)
- Y. Choi, "Improving ESRGAN with an additional image quality loss", Multimedia Tools and Applications (2022)
- E. Agustsson, "Ntire 2017 challenge on single image super-resolution: dataset and study", Proc. of CVPRW, pp.126~135 (2017)
- M. Bevilacqua, "Low complexity single image super-resolution based on nonnegative neighbor embedding", Proc. BMVC (2012)
- R. Zeyde, "On single image scale-up using sparse-representations", Proc. of Int. Conf. on Curves and Surfaces, pp.711~730 (2010)
- D. Martin, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics", Proc. ICCV, 2, pp.416~423 (2001)
- J.-B. Huang, "Single image super-resolution from transformed self-exemplars", Proc. of CVPR, pp.5197~5206 (2015)
- C. Ma, "Learning a no-Reference quality metric for single-image super-resolution", CVIU, 158, pp.1~16 (2017)
- A. Mittal, "Making a completely blind image quality analyzer", IEEE Signal Processing Letters, 20(3), pp.209~212 (2013)