A new engineering approach to reveal correlation of physiological change and spontaneous expression from video images

Fenglei Yang; Sijung Hu; Xiaoyun Ma; Harnani Hassan; Dongqing Wei

doi:10.1117/12.2077120

5 March 2015 A new engineering approach to reveal correlation of physiological change and spontaneous expression from video images

Fenglei Yang, Sijung Hu, Xiaoyun Ma, Harnani Hassan, Dongqing Wei

Author Affiliations +

Proceedings Volume 9315, Design and Quality for Biomedical Technologies VIII; 93150M (2015) https://doi.org/10.1117/12.2077120
Event: SPIE BiOS, 2015, San Francisco, California, United States

Abstract

Spontaneous expression is associated with physiological states, i.e., heart rate, respiration, oxygen saturation (SpO2%), and heart rate variability (HRV). There have yet not sufficient efforts to explore correlation of physiological change and spontaneous expression. This study aims to study how spontaneous expression is associated with physiological changes with an approved protocol or through the videos provided from Denver Intensity of Spontaneous Facial Action Database. Not like a posed expression, motion artefact in spontaneous expression is one of evitable challenges to be overcome in the study. To obtain a physiological signs from a region of interest (ROI), a new engineering approach is being developed with an artefact-reduction method consolidated 3D active appearance model (AAM) based track, affine transformation based alignment with opto-physiological mode based imaging photoplethysmography. Also, a statistical association spaces is being used to interpret correlation of spontaneous expressions and physiological states including their probability densities by means of Gaussian Mixture Model. The present work is revealing a new avenue of study associations of spontaneous expressions and physiological states with its prospect of applications on physiological and psychological assessment.

Citation Download Citation

Fenglei Yang, Sijung Hu, Xiaoyun Ma, Harnani Hassan, and Dongqing Wei "A new engineering approach to reveal correlation of physiological change and spontaneous expression from video images", Proc. SPIE 9315, Design and Quality for Biomedical Technologies VIII, 93150M (5 March 2015); https://doi.org/10.1117/12.2077120

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available