디지털휴먼 기술을 활용한 표현연구
Research on expression methods using digital human technology
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
This study aims to examine the rapidly developing trend of digital human technology and to suggest ways to use it in movies and dramas. First, literature research is conducted to analyze the current technology level of digital human production. Focusing on recent studies published at home and abroad, we analyzed technologies that can be actually applied to movies and dramas. In the field of visual effects, digital humans have been developed and developed mainly with technologies called digital actors and digital double to replace action and dangerous scenes in major roles. Technology applied with artificial intelligence technology is being applied to film and drama production, and it is expected that digital humans will soon have the ability to reproduce indistinguishable from real people. The application of digital humans in film and drama production is actually solving some problems. With the development of technology, digital actors, which were previously used in place of stunts, have been able to act as leading actors in movies and dramas. To sum up the technologies analyzed in this paper, the core technology of digital human production to complete fake actors that are currently indistinguishable from reality is the actor's face restoration technology. In particular, in recent years, face restoration technology has been mainly used in re-aging technology that makes actors young or old. Methods of applying re-aging technology can be largely divided into two types. One is to use a shadow actor to replace the actor's face, and the other is to replace only the face on the actor's body. The technique for determining the age of actors represented in dramas and movies should be applied to both the face and body. The way to achieve this means using shadow actors, or adding detailed body compositing in post-processing. Technology, especially visual effects, should not be revealed, and should be designed so as not to harm the narrative of the film. The application of digital humans in film and drama production offers new possibilities for producers by recreating the deceased actor or by introducing the old actor's original appearance as a young person. However, until the fictional actor occupies the screen and TV, the current digital human will have to be used to avoid breaking the immersion of the video. It seems that it is still too much to use digital human technology to not miss the performance of a great actor.
Abstract
This study aims to examine the rapidly developing trend of digital human technology and to suggest ways to use it in movies and dramas. First, literature research is conducted to analyze the current technology level of digital human production. Focusing on recent studies published at home and abroad, we analyzed technologies that can be actually applied to movies and dramas. In the field of visual effects, digital humans have been developed and developed mainly with technologies called digital actors and digital double to replace action and dangerous scenes in major roles. Technology applied with artificial intelligence technology is being applied to film and drama production, and it is expected that digital humans will soon have the ability to reproduce indistinguishable from real people. The application of digital humans in film and drama production is actually solving some problems. With the development of technology, digital actors, which were previously used in place of stunts, have been able to act as leading actors in movies and dramas. To sum up the technologies analyzed in this paper, the core technology of digital human production to complete fake actors that are currently indistinguishable from reality is the actor's face restoration technology. In particular, in recent years, face restoration technology has been mainly used in re-aging technology that makes actors young or old. Methods of applying re-aging technology can be largely divided into two types. One is to use a shadow actor to replace the actor's face, and the other is to replace only the face on the actor's body. The technique for determining the age of actors represented in dramas and movies should be applied to both the face and body. The way to achieve this means using shadow actors, or adding detailed body compositing in post-processing. Technology, especially visual effects, should not be revealed, and should be designed so as not to harm the narrative of the film. The application of digital humans in film and drama production offers new possibilities for producers by recreating the deceased actor or by introducing the old actor's original appearance as a young person. However, until the fictional actor occupies the screen and TV, the current digital human will have to be used to avoid breaking the immersion of the video. It seems that it is still too much to use digital human technology to not miss the performance of a great actor.
참고문헌 (38)
- 남현우, "디지털 휴먼 개발 기술의 현황과 전망", 한국통신학회지(정보와통신), 39(5) (2022)
- 박민규, "메타버스 서비스를 위한 휴먼 모델링 기술 동향", 방송과 미디어, 26(4) (2021)
- 안재곤, "상업영화 제작 사례를 통한 3D Digital actor활용에 관한 접근 - 영화 <과속 스캔들> 시각효과 제작 사례 중심으로 -", 디지털디자인학연구, 10(1), pp.245~254 (2010), 한국디지털디자인학회[DOI]
- 오문석, "메타버스를 위한 디지털 휴먼과 메타휴먼의 제작기법 분석 연구", 한국디자인리서치, 6(3), pp.133~142 (2021), 한국디자인리서치학회[DOI]
- 오문석, "4D 볼류메트릭 캡처를 위한 그래픽스 파이프라인 분석 연구", 한국디자인리서치, 6(3), pp.9~18 (2021), 한국디자인리서치학회[DOI]
- 유태경, "인공지능을 이용한 영화제작 : 시각효과를 중심으로", 한국엔터테인먼트산업학회논문지, 15(1), pp.53~62 (2021), 한국엔터테인먼트산업학회[DOI]
- 이승욱, "디지털 휴먼의 실감 가시화 기술 연구", 한국통신학회지 (정보와통신), 39(5) (2022)
- Amit H. Bermano, "Facial performance enhancement using dynamic shape space analysis", ACM Transactions on Graphics, 33(2), pp.1~12 (2014), Association for Computing Machinery (ACM)[DOI]
- Pablo Garrido, "Reconstruction of Personalized 3D Face Rigs from Monocular Video", ACM Transactions on Graphics, 35(3), pp.1~15 (2016), Association for Computing Machinery (ACM)[DOI]
- Gaspard Zoss, "Production-Ready Face Re-Aging for Visual Effects", ACM Transactions on Graphics, 41(6), pp.1~12 (2022), Association for Computing Machinery (ACM)[DOI]
- Kaiwen Guo, "The relightables", ACM Transactions on Graphics, 38(6), pp.1~19 (2019), Association for Computing Machinery (ACM)[DOI]
- Lingjie Liu, "Neural actor", ACM Transactions on Graphics, 40(6), pp.1~16 (2021), Association for Computing Machinery (ACM)[DOI]
- Lucio Moser, "Masquerade: fine-scale details for head-mounted camera motion capture data", ACM SIGGRAPH 2017 Talks (2017), ACM
- Perov, I., "DeepFaceLab: Integrated, flexible and extensible face-swapping framework" (2020)[DOI]
- Saito, S., "Pifu: Pixel-aligned implicit function for high-resolution clothed human digitization", Proceedings of the IEEE, 2019, ~
- Steven L. Song, "Accurate face rig approximation with deep differential subspace reconstruction", ACM Transactions on Graphics, 39(4) (2020), Association for Computing Machinery (ACM)[DOI]
- Thies, J., "Face2Face: Real-Time Face Capture and Reenactment of RGB Videos", 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)
- 이승환, "메타버스 비긴즈(BEGINS):5대이슈와 전망", 월간 SW중심사회, (5) (2021)
- 임화섭, "디지털 휴먼을 이용한 비대면 시대 실감형 콘텐츠 기술 소개", 융합연구리뷰, 7(3) (2021)
- 한상렬, "메타버스 新인류 디지털 휴먼", 월간 SW중심사회, (1) (2022)
- "디지털 휴먼 기술 동향과 문화체육 관광분야 활용 전망"[URL]
