독립 요소 분석을이용한 얼굴 표정의 매개변수화
On Parameterizing of Human Expression Using ICA
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
본 논문에서는 표정을 매개변수 공간에서 표현하고 응용하기 위한 새로운 방법을 제안한다. 컴퓨터 애니메이션 분야에서 복잡한 얼굴 표정을 보다 간단하게 표현하기 위해 표정을 매개변수화 하기 위한 다양한 연구들이이루어졌다. 본 논문에서는 사람의 얼굴 표정을 포착한 데이터를 이용하여 표정을 구성하는 간단한 몇 개의 주요움직임을 분석한다. 이를위해먼저표정매개변수화를애니메이션에효과적으로적용하기위해필요한요구사항을정리하고,기존연구들의 제한점을 파악한다. 본 논문에서는 많은 양의 표정 데이터에 독립 요소 분석(independent component analysis)기법을 적용함으로써 사람의 표정을 나타내는 독립적인 움직임을 추출하고 표정의 매개변수 공간을 구성한다. 또한 얼굴의 비선형적 움직임을 보다 정확하게 근사하기 위한 변형 모델과 데이터를 기반으로 변형 모델을 학습하기 위한 방법을 제안한다. 이러한 과정을 통하여 직관적으로 일반 사용자도 쉽게 표정을 제어할 수 있는 매개변수 집합과 변형 모델을 얻을 수 있다.
Abstract
In this paper, a novel framework that synthesizes and clones facial expression in parameter spaces is presented. To overcome the difficulties in manipulating face geometry models with high degrees of freedom, many parameterization methods have been introduced. In this paper, a data-driven parameterization method is proposed that represents a variety of expressions with a small set of fundamental independent movements based on the ICA technique. The face deformation due to the parameters is also learned from the data to capture the nonlinearity of facial movements. With this parameterization, one can control the expression of an animated character’s face by the parameters. By separating the parameterization and the deformation learning process, we believe that we can adopt this framework for a variety applications including expression synthesis and cloning. The experimental result demonstrates the efficient production of realistic expressions using the proposed method.
참고문헌 (31)
- P. Ekman, "Facial action coding system:A technique for the measurement of facial movement" (1978), Consulting Psychologist Press
- L. Torresani, "Tracking and modeling non-rigid objects with rank con- Recognition (CVPR 2001)", 493~500 (2001)
- B. Choe, "Performance-driven musclebased facial animation", Journal of Visualization and Computer Animation, 12(2), pp.67~79 (2001)
- P. Joshi, "Learning controls for blend shape based realistic facial animation", 2003 ACM SIGGRAPH, 2003, 187~192
- E. Chuang, "Mood swings:expressive speech animation", ACM Transactions on Graphics, 24(2), pp.331~347 (2005)
- V. Blanz, "A morphable model for the synthesis of 3d faces", Proceedings of SIGGRAPH 99, ser. Computer Graphics Proceedings, Annual Conference Series, pp.187~194 (1999)
- L. Williams, "Performance driven facial animation", Proceedings of SIGGRAPH 90, pp.235~242 (1990)
- P. Kalra, "Simulation of facial muscle actions based on rational free form deformations", 11(3), pp.59~69 (1992)
- H. Li, "3-d motion estimation in model-based facial image coding", IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(6), pp.545~555 (1993)
- I. Essa, "Modeling, tracking and interactive animation of faces and heads: Using input from video", Computer Animation ’96, pp.68~79 (1996)
- M. Escher, "Facial deformations for mpeg-4", Computer Animation ’98 (1998)
- D. Fidaleo, "Classification and volume morphing for performance driven facial animation", International Workshop on Digital and Computational Video (2000)
- L. Zhang, "Spacetime faces:high resolution capture for modeling and animation", ACM Transactions on Graphics, 23(3), pp.548~558 (2004)
- J.-Y. Noh, "Expression cloning", Proceedings of ACM SIGGRAPH 2001, ser. Computer Graphics Proceedings, Annual Conference Series, pp.277~288 (2001)
- D. Vlasic, "Face transfer with multilinear models", ACM Transactions on Graphics, 24(3), pp.426~433 (2005)
- F.I.Parke, "Parameterized models for facial animation", IEEE Computer Graphics & Applications, 2(1), pp.61~68 (1982)
- Y. Lee, "Realistic modeling for facial animation", Proceedings of SIGGRAPH 95, ser. Computer Graphics Proceedings, Annual Conference Series, pp.55~62 (1995)
- K.Waters, "A muscle model for animating three-dimensional facial expression", Computer Graphics (Proceedings of SIGGRAPH 87), pp.17~24 (1987)
- K. Waters, "A coordinated muscle model for speech animation", Graphics Interface ’95, pp.163~170 (1995)
- S. M. Platt, "Animating facial expressions", Computer Graphics (Proceedings of SIGGRAPH 81), pp.245~252 (1981)
- E. S. Chuang, "Facial expression space learning", 10th Pacific Conference on Computer Graphics and Applications, pp.68~76 (2002)
- E. Sifakis, "Automatic determination of facial muscle activations from sparse motion capture marker data", ACM Transactions on Graphics, 24(3), pp.417~425 (2005)
- E. Sifakis, "Simulating speech with a physics-based facial muscle model", 2006 ACM SIGGRAPH, 2006, 261~270
- A. Hyv¨arinen, "Independent component analysis:Algorithms and applications", Neural Networks, 13(4-5), pp.411~430 (2000)
- H. Mori, "Independent component analysis of human motion", Proceedings of International Conference on Acoustics Speech and Signal Processing, VI, pp.3564~3567 (2002)
- Y. Cao, "Unsupervised learning for speech motion editing", 2003 ACM SIGGRAPH, 2003, 225~231
- A. Shapiro, "Style components", Graphics Interface 2006, pp.33~39 (2006)
- D. Fidaleo, "Analysis of co-articulation regions for performance-driven facial animation", Computer Animation and Virtual Worlds, 15(1), pp.15~26 (2004)
- "Welcome to IT++"[URL]
- G. A. Kalberer, "Speech animation using viseme space", Vision, Modeling, and Visualization VMV 2002. Akademische Verlagsgesellschaft Aka GmbH, pp.463~470 (2002)
- B. Yin, "General face animation expression based on ica", 1, pp.181~185 (2005)