Comparison of GAN Deep Learning Methods for Underwater Optical Image Enhancement
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Underwater optical images face various limitations that degrade the image quality compared with optical images taken in our atmosphere. Attenuation according to the wavelength of light and reflection by very small floating objects cause low contrast, blurry clarity, and color degradation in underwater images. We constructed an image data of the Korean sea and enhanced it by learning the characteristics of underwater images using the deep learning techniques of CycleGAN (cycle-consistent adversarial network), UGAN (underwater GAN), FUnIE-GAN (fast underwater image enhancement GAN). In addition, the underwater optical image was enhanced using the image processing technique of Image Fusion. For a quantitative performance comparison, UIQM (underwater image quality measure), which evaluates the performance of the enhancement in terms of colorfulness, sharpness, and contrast, and UCIQE (underwater color image quality evaluation), which evaluates the performance in terms of chroma, luminance, and saturation were calculated. For 100 underwater images taken in Korean seas, the average UIQMs of CycleGAN, UGAN, and FUnIE-GAN were 3.91, 3.42, and 2.66, respectively, and the average UCIQEs were measured to be 29.9, 26.77, and 22.88, respectively. The average UIQM and UCIQE of Image Fusion were 3.63 and 23.59, respectively. CycleGAN and UGAN qualitatively and quantitatively improved the image quality in various underwater environments, and FUnIE-GAN had performance differences depending on the underwater environment. Image Fusion showed good performance in terms of color correction and sharpness enhancement. It is expected that this method can be used for monitoring underwater works and the autonomous operation of unmanned vehicles by improving the visibility of underwater situations more accurately.
Abstract
Underwater optical images face various limitations that degrade the image quality compared with optical images taken in our atmosphere. Attenuation according to the wavelength of light and reflection by very small floating objects cause low contrast, blurry clarity, and color degradation in underwater images. We constructed an image data of the Korean sea and enhanced it by learning the characteristics of underwater images using the deep learning techniques of CycleGAN (cycle-consistent adversarial network), UGAN (underwater GAN), FUnIE-GAN (fast underwater image enhancement GAN). In addition, the underwater optical image was enhanced using the image processing technique of Image Fusion. For a quantitative performance comparison, UIQM (underwater image quality measure), which evaluates the performance of the enhancement in terms of colorfulness, sharpness, and contrast, and UCIQE (underwater color image quality evaluation), which evaluates the performance in terms of chroma, luminance, and saturation were calculated. For 100 underwater images taken in Korean seas, the average UIQMs of CycleGAN, UGAN, and FUnIE-GAN were 3.91, 3.42, and 2.66, respectively, and the average UCIQEs were measured to be 29.9, 26.77, and 22.88, respectively. The average UIQM and UCIQE of Image Fusion were 3.63 and 23.59, respectively. CycleGAN and UGAN qualitatively and quantitatively improved the image quality in various underwater environments, and FUnIE-GAN had performance differences depending on the underwater environment. Image Fusion showed good performance in terms of color correction and sharpness enhancement. It is expected that this method can be used for monitoring underwater works and the autonomous operation of unmanned vehicles by improving the visibility of underwater situations more accurately.
참고문헌 (23)
- Codruta O. Ancuti, "Color Balance and Fusion for Underwater Image Enhancement", IEEE Transactions on Image Processing, 27(1), pp.379~393 (2018), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- Arjovsky, M, "Wasserstein Generative Adversarial Networks", Proceedings of the 34th International Conference on Machine Learning, 70, pp.214~223 (2017)
- Bharal, S, "Review of Underwater Image Enhancement Techniques", International Research Journal of Engineering and Technology, 2(3), pp.340~344 (2015)
- Xingyu Chen, "Towards Real-Time Advancement of Underwater Visual Quality With GAN", IEEE Transactions on Industrial Electronics, 66(12), pp.9350~9359 (2019), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- Deng, J, "Imagenet: A Large-Scale Hierarchical Image Database", 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp.248~255 (2009)
- Fabbri, C, "Enhancing Underwater Imagery Using Generative Adversarial Networks", 2018 IEEE International Conference on Robotics and Automation (ICRA), pp.7159~7165 (2018)
- Goodfellow, I, "Generative Adversarial Nets", Advances in Neural Information Processing Systems, 27 (2014)
- Min Han, "A Review on Intelligence Dehazing and Color Restoration for Underwater Images", IEEE Transactions on Systems, Man, and Cybernetics: Systems, 50(5), pp.1820~1832 (2020), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- He, K, "Single Image Haze Removal Using Dark Channel Prior", IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(12), pp.2341~2353 (2010)[DOI]
- He, K, "Deep Residual Learning for Image Recognition", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.770~778 (2016)
- Islam, M. J, "Fast Underwater Image Enhancement for Improved Visual Perception", IEEE Robotics and Automation Letters, 5(2), pp.3227~3234 (2020)[DOI]
- Do Gyun Kim, "Single Image-based Enhancement Techniques for Underwater Optical Imaging", 한국해양공학회지, 34(6), pp.442~453 (2020), 한국해양공학회[DOI]
- Li, C.Y, "Cast-Gan: Learning to Retmove Colour Cast From Underwater Images", 2020 IEEE International Conference on Image Processing (ICIP), pp.1083~1087 (2020)
- Li, W. J., "Single Image Visibility Enhancement in Gradient Domain", IET Image Processing, 6(5), pp.589~595 (2012)
- Mobley, C. D, "Light and Water: Radiative Transfer in Natural Waters" (1994), Academic Press
- Panetta, K, "Human-Visual-SystemInspired Underwater Image Quality Measures", IEEE Journal of Oceanic Engineering, 41(3), pp.541~555 (2015)[DOI]
- Ronneberger, O, "U-Net:Convolutional Networks for Biomedical Image Segmentation", International Conference on Medical Image Computing and Computer-Assisted Intervention, pp.234~241 (2015)
- Schettini, R, "Underwater Image Processing:State of the Art of Restoration and Image Enhancement Methods", EURASIP Journal on Advances in Signal Processing, 2010, pp.1~14 (2010)[DOI]
- Uplavikar, P. M, "All-in-One Underwater Image Enhancement Using Domain-Adversarial Learning", CVPR Workshops, pp.1~8 (2019)
- Wang, J, "CA-GAN: Class-Condition Attention GAN for A Underwater Image Enhancement", IEEE Access, 8, pp.130719~130728 (2020)[DOI]
- Yang, M, "An Underwater Color Image Quality Evaluation Metric", IEEE Transactions on Image Processing, 24(12), pp.6062~6071 (2015)[DOI]
- Zhang, T, "Underwater Image Enhancement Using Improved Generative Adversarial Network", Concurrency and Computation: Practice and Experience, 33(22), pp.e5841~ (2021)[DOI]
- Zhu, J. Y, "Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks", Proceedings of the IEEE International Conference on Computer Vision, pp.2223~2232 (2017)