Real-time tracking and imitation of facial expression

Xiang Cao; Baining Guo

doi:10.1117/12.477090

31 July 2002 Real-time tracking and imitation of facial expression

Xiang Cao, Baining Guo

Proceedings Volume 4875, Second International Conference on Image and Graphics; (2002) https://doi.org/10.1117/12.477090
Event: Second International Conference on Image and Graphics, 2002, Hefei, China

Abstract

We present a system for tracking facial expression and head pose with one camera and no special markers, and generating a face animation to imitate these expressions simultaneously. The tracking is based on Gabor wavelet coefficients (jets) of the facial feature points, a saccadic searching strategy, and a model-based adjustment. Using Principal Components Analysis (PCA), we established an expression model and use it to drive the imitation animation. The system runs in real-time and the tracking shows robustness against illumination/background variation, accumulative error and partial occlusion. The imitation animation captures both the expression and the head pose without 3D information.

Citation Download Citation

Xiang Cao and Baining Guo "Real-time tracking and imitation of facial expression", Proc. SPIE 4875, Second International Conference on Image and Graphics, (31 July 2002); https://doi.org/10.1117/12.477090

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available