본문 바로가기
KERD
논문KCI 등재

노이즈가 완화된 거품 효과를 표현하기 위한 인공신경망 기반의 투영맵 정제

Refinement of Projection Map Based on Artificial Neural Networks to Represent Noise-Reduced Foam Effects

김종현
(사)한국컴퓨터그래픽스학회 (Korea Computer Graphics Society)|2021.09|한국컴퓨터그래픽스학회논문지 (Journal of the Korea Computer Graphics Society)|제27권 제4호|pp. 11-24|DOI 10.15701/kcgs.2021.27.4.1

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

인공신경망유체 시뮬레이션DenoisingArtificial neural networks디노이징Fluid simulationsFoam effects거품 효과투영맵Projection map

초록

본 논문에서는 액체 시뮬레이션에서 표현되는 거품 효과(Foam effects)를 노이즈 없이 디테일하게 표현할 수 있는 인공신경망 프레임워크를 제안한다. 거품 입자의 생성 위치와 이류는 기존의 스크린 투영법을 활용하여 계산되며, 이 과정에서 나타나는 노이즈 문제를 인공신경망을 통해 풀어낸다. 스크린 투영 접근법에서 중요한 것은 투영맵이지만이산화된 스크린 공간에 운동량을 투영하는 과정에서 투영맵에 노이즈가 발생하며, 우리는 인공신경망 기반의 디노이징(Denoising) 네트워크를 활용하여 이 문제를 효율적으로 풀어낸다. 투영맵을 통해 거품 생성 영역이 선별되면 2D 를 3D 공간으로 역변환하여 거품 입자를 생성한다. 우리는 작은 크기의 거품들이 소실되는 기존의 디노이징 네트워크문제를 해결하였다. 뿐만 아니라, 제안하는 알고리즘을 스크린 공간 투영 프레임워크와 통합함으로써 이 접근법이 갖는모든 장점을 그대로 수용할 수 있다. 결과적으로 깔끔한 거품 효과 뿐만 아니라, 디노이징 과정으로 인해 소실된 거품을안정적으로 표현할 수 있는지 다양한 실험을 통해 보여준다.

Abstract

In this paper, we propose an artificial neural network framework that can represent the foam effects expressed in liquid simulation in detail without noise. The position and advection of foam particles are calculated using the existing screen projection method, and the noise problem that appears in this process is solved through an proposed artificial neural network. The important thing in the screen projection approach is the projection map, but noise occurs in the projection map in the process of projecting momentum into the discretized screen space, and we efficiently solve this problem by using an artificial neural network-based denoising network. When the foam generating area is selected through the projection map, 2D is inversely transformed into 3D space to generate foam particles. We solve the existing denoising network problem in which small-scaled foam particles disappear. In addition, by integrating the proposed algorithm with the screen-space projection framework, all the advantages of this approach can be accommodated. As a result, it shows through various experiments whether it is possible to stably represent not only the clean foam effects but also the foam particles lost due to the denoising process.

참고문헌 (63)

  1. N. Chentanez, "Real-time eulerian water simulation using a restricted tall cell grid", ACM Siggraph 2011Papers, pp.1~10 (2011)
  2. C. Jiang, "The affine particle-in-cell method", ACM Transactions on Graphics(TOG), 34(4), pp.1~10 (2015)
  3. M. Cha, "A data-driven visual simulation of fire phenomena", SIGGRAPH’09:Posters, pp.1~1 (2009)
  4. P. Beaudoin, "Realistic and controllable fire simulation", Graphics Interface, 2001, pp.159~166 (2001)
  5. D. Q. Nguyen, "Physically based modeling and animation of fire", Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pp.721~728 (2002)
  6. N. Rasmussen, "Smoke simulation for large scale phenomena", ACM SIGGRAPH 2003 Papers, pp.703~707 (2003)
  7. R. Setaluri, "Spgrid : A sparse paged grid structure applied to adaptive smoke simulation", ACM Transactions on Graphics(TOG), 33(6), pp.1~12 (2014)
  8. R. Fattal, "Target-driven smoke animation", ACM SIGGRAPH 2004 Papers, pp.441~448 (2004)
  9. T. Kim, "Visual simulation of fire-flakes synchronized with flame", The Visual Computer, 33(6), pp.1029~1038 (2017)
  10. J. -H. Kim, "Fire sprite animation using fire-flake texture and artificial motion blur", IEEE Access, 7, pp.110 002~110 011 (2019)
  11. M. Choi, "Learning representation of secondary effects for fire-flake animation", IEEE Access, 9, pp.17 620~17 630 (2021)
  12. B. Kim, "Simulation of bubbles in foam with the volume control method", ACM Transactions on Graphics(TOG), 26(3), pp.98~ (2007)
  13. O. Busaryev, "Animating bubble interactions in a liquid foam", ACM Transactions on Graphics(TOG), 31(4), pp.1~8 (2012)
  14. J. -M. Hong, "Bubbles alive", ACM Transactions on Graphics(TOG), 27(3), pp.1~4 (2008)
  15. D. Kim, "A practical simulation of dispersed bubble flow", ACM SIGGRAPH 2010 papers, pp.1~5 (2010)
  16. F. Dagenais, "An efficient layered simulation workflow for snow imprints", The visual computer, 32(6), pp.881~890 (2016)
  17. M. B. Nielsen, "A two-continua approach to eulerian simulation of water spray", ACM Transactions on Graphics(TOG), 32(4), pp.1~10 (2013)
  18. J. Kim, "Practical animation of turbulent splashing water", Symposium on Computer Animation, pp.335~344 (2006)
  19. M. Ihmsen, "Unified spray, foam and air bubbles for particle-based fluids", The Visual Computer, 28(6), pp.669~677 (2012)
  20. W. J. van der Laan, "Screen space fluid rendering with curvature flow", Proceedings of the 2009 symposium on Interactive 3D graphics and games, pp.91~98 (2009)
  21. F. Bagar, "A layered particlebased fluid model for real-time rendering of water", Computer Graphics Forum, 29(4), pp.1383~1389 (2010)
  22. J. -H. Kim, "Synthesizing large-scale fluid simulations with surface and wave foams via sharp wave pattern and cloudy foam", Computer Animation and Virtual Worlds, 32(2), pp.e1984~ (2021)
  23. J. -H. Kim, "Efficient representation of detailed foam waves by incorporating projective space", IEEE transactions on visualization and computer graphics, 23(9), pp.2056~2068 (2016)
  24. T. Takahashi, "Realistic animation of fluid with splash and foam", Computer Graphics Forum, 22(3), pp.391~400 (2003)
  25. W. Geiger, "So real it’ll make you wet", ACM SIGGRAPH 2006Sketches, pp.20~ (2006)
  26. F. Losasso, "Twoway coupled sph and particle level set fluid simulation", IEEE Transactions on Visualization and Computer Graphics, 14(4), pp.797~804 (2008)
  27. V. Mihalef, "Simulation of two-phase flow with sub-scale droplet and bubble effects", Computer Graphics Forum, 28(2), pp.229~238 (2009)
  28. C. -b. Wang, "Hybrid particle–grid fluid animation with enhanced details", The Visual Computer, 29(9), pp.937~947 (2013)
  29. N. Truong, "A narrow-range filter for screenspace fluid rendering", Proceedings of the ACM on Computer Graphics and Interactive Techniques, 1(1), pp.1~15 (2018)
  30. Screen space foam rendering, "N. Akinci", ~ (2013)
  31. M. Muller, "Screen space meshes", Proceedings of the 2007 ACM SIGGRAPH, 2007, 9~15
  32. B. Kim, "Deep fluids : A generative network for parameterized fluid simulations", Computer Graphics Forum, 38(2), pp.59~70 (2019)
  33. Y. Xie, "tempogan : A temporally coherent, volumetric gan for super-resolution fluid flow", ACM Transactions on Graphics(TOG), 37(4), pp.1~15 (2018)
  34. M. Chu, "Data-driven synthesis of smoke flows with cnn-based feature descriptors", ACM Transactions on Graphics(TOG), 36(4), pp.1~14 (2017)
  35. M. Werhahn, "A multi-pass gan for fluid flow super-resolution", Proceedings of the ACM on Computer Graphics and Interactive Techniques, 2(2), pp.1~21 (2019)
  36. J. Tompson, "Accelerating eulerian fluid simulation with convolutional networks", International Conference on Machine Learning, pp.3424~3433 (2017)
  37. X. Xiao, "A novel cnn-based poisson solver for fluid simulation", IEEE transactions on visualization and computer graphics, 26(3), pp.1454~1465 (2018)
  38. C. Dong, "Image superresolution using deep convolutional networks", IEEE transactions on pattern analysis and machine intelligence, 38(2), pp.295~307 (2015)
  39. C. Ledig, "Photo-realistic single image super-resolution using a generative adversarial network", Proceedings of the IEEE conference on computer vision and pattern recognition, pp.4681~4690 (2017)
  40. M. Chu, "Temporally coherent gans for video super-resolution(tecogan)", arXiv preprint arXiv : 1811. 09393, 3~ (2018)
  41. K. Bai, "Dynamic upsampling of smoke through dictionary-based learning", arXiv preprint arXiv : 1910. 09166, ~ (2019)
  42. V. Jain, "Natural image denoising with convolutional networks", Advances in neural information processing systems, 21 (2008)
  43. F. Agostinelli, "Adaptive multicolumn deep neural networks with application to robust image denoising", Advances in neural information processing systems, pp.1493~1501 (2013)
  44. J. Xie, "Image denoising and inpainting with deep neural networks", Advances in neural information processing systems, pp.341~349 (2012)
  45. H. C. Burger, "Image denoising:Can plain neural networks compete with bm3d?", 2012IEEE conference on computer vision and pattern recognition, pp.2392~2399 (2012)
  46. K. Dabov, "Image denoising by sparse 3-d transform-domain collaborative filtering", IEEE Transactions on image processing, 16(8), pp.2080~2095 (2007)
  47. K. Zhang, "Beyond a gaussian denoiser : Residual learning of deep cnn for image denoising", IEEE transactions on image processing, 26(7), pp.3142~3155 (2017)
  48. X. Mao, "Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections", Advances in neural information processing systems, 29, pp.2802~2810 (2016)
  49. Y. Tai, "Memnet : A persistent memory network for image restoration", Proceedings of the IEEE international conference on computer vision, pp.4539~4547 (2017)
  50. D. Liu, "Nonlocal recurrent network for image restoration", arXiv preprint arXiv : 1806. 02919, ~ (2018)
  51. T. Plotz, "Neural nearest neighbors networks", arXiv preprint arXiv : 1810. 12575, ~ (2018)
  52. S. Lefkimmiatis, "Universal denoising networks : a novel cnn architecture for image denoising", Proceedings of the IEEE conference on computer vision and pattern recognition, pp.3204~3213 (2018)
  53. K. Zhang, "Ffdnet : Toward a fast and flexible solution for cnn-based image denoising", IEEE Transactions on Image Processing, 27(9), pp.4608~4622 (2018)
  54. S. Guo, "Toward convolutional blind denoising of real photographs", Proceedings of the IEEE, 2019, 1712~1722
  55. T. Brooks, "Unprocessing images for learned raw denoising", Proceedings of the IEEE, 2019, 11 036~11 045
  56. Y. Zhu, "Animating sand as a fluid", ACM Transactions on Graphics(TOG), 24(3), pp.965~972 (2005)
  57. R. Li, "Gpu-accelerated preconditioned iterative linear solvers", The Journal of Supercomputing, 63(2), pp.443~466 (2013)
  58. F. H. Harlow, "Numerical calculation of timedependent viscous incompressible flow of fluid with free surface", The physics of fluids, 8(12), pp.2182~2189 (1965)
  59. N. Akinci, "Coupling elastic solids with smoothed particle hydrodynamics fluids", Computer Animation and Virtual Worlds, 24(3-4), pp.195~203 (2013)
  60. "TensorFlow: Large-scale machine learning on heterogeneous systems" (2015)[URL]
  61. Z. Yue, "Variational denoising network : Toward blind noise modeling and removal", arXiv preprint arXiv : 1908. 11314, ~ (2019)
  62. A. Frasson, "Efficient screenspace rendering of vector features on virtual terrains", Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pp.1~10 (2018)
  63. Real-time hair rendering with screen space adaptive level of detail, "M. Rapp", ~

관련 논문AI추천

수면거품과 웨이브거품의 미세한 상호작용을 이용한 대규모 유체 시뮬레이션김종현(사)한국컴퓨터그래픽스학회 · 한국컴퓨터그래픽스학회논문지2017 · 제23권 제2호입자 기반 유체 시뮬레이션에서 디테일한 액체 시트를 표현하기 위한 보존과 분해 기법김종현(사)한국컴퓨터그래픽스학회 · 한국컴퓨터그래픽스학회논문지2019 · 제25권 제1호액체 시뮬레이션의 얇은 특징을 빠르게 표현하기 위한 CPU와 GPU 이기종 컴퓨팅 기술김종현(사)한국컴퓨터그래픽스학회 · 한국컴퓨터그래픽스학회논문지2018 · 제24권 제2호자유표면내 물의 와류효과를 위한 적응적 공기입자 기법이정, 김종현(사)한국컴퓨터그래픽스학회 · 한국컴퓨터그래픽스학회논문지2017 · 제23권 제1호CNN을 이용한 Quad Tree 기반 2D Smoke Super-resolution김창헌, 박지혁, 최명진, 홍병선(사)한국컴퓨터그래픽스학회 · 한국컴퓨터그래픽스학회논문지2019 · 제25권 제3호유체 시뮬레이션의 격자 내 상세도 향상을 위한 와류 입자 혼합 기법김창헌, 윤종철, 홍정모(사)한국컴퓨터그래픽스학회 · 한국컴퓨터그래픽스학회논문지2008 · 제14권 제4호

이 간행물의 다른 논문 (1건)

뉴런 추적 및 딥러닝 기반의 대화형 뉴런 구조 교정 기법최준영, 정원기pp. 1-9
원문 보기