Facial expression analysis using nonlinear decomposable generative models

Chan Su Lee, Ahmed Elgammal

Research output: Chapter in Book/Report/Conference proceedingConference contribution

22 Scopus citations


We present a new framework to represent and analyze dynamic facial motions using a decomposable generative model. In this paper, we consider facial expressions which lie on a one dimensional closed manifold, i.e., start from some configuration and coming back to the same configuration, while there are other sources of variability such as different classes of expression, and different people, etc., all of which are needed to be parameterized. The learned model supports tasks such as facial expression recognition, person identification, and synthesis. We aim to learn a generative model that can generate different dynamic facial appearances for different people and for different expressions. Given a single image or a sequence of images, we can use the model to solve for the temporal embedding, expression type and person identification parameters. As a result we can directly infer intensity of facial expression, expression type, and person identity from the visual input. The model can successfully be used to recognize expressions performed by different people never seen during training. We show experiment results for applying the framework for simultaneous face and facial expression recognition.

Original languageEnglish (US)
Title of host publicationAnalysis and Modelling of Faces and Gestures - Second International Workshop, AMFG 2005, Proceedings
PublisherSpringer Verlag
Number of pages15
ISBN (Print)3540292292, 9783540292296
StatePublished - 2005
Event2nd International Workshop on Analysis and Modelling of Faces and Gestures, AMFG 2005 - Beijing, China
Duration: Oct 16 2005Oct 16 2005

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume3723 LNCS


Other2nd International Workshop on Analysis and Modelling of Faces and Gestures, AMFG 2005

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'Facial expression analysis using nonlinear decomposable generative models'. Together they form a unique fingerprint.

Cite this