Dynamic shape style analysis: Bilinear and multilinear human identification with temporal normalization

Chan Su Lee, Ahmed Elgammal

Research output: Contribution to journalArticle

4 Scopus citations

Abstract

Modeling and analyzing the dynamic shape of human motion is a challenging task owing to temporal variations in the shape and multiple sources of observed shape variations such as viewpoint, motion speed, clothing, etc. We present a new framework for dynamic shape analysis based on temporal normalization and factorized shape style analysis. Using a nonlinear generative model with motion manifold embedding in a low-dimensional space, we detect cycles of periodic motion like gait in different views and synthesize temporally-aligned shape sequences from the same type of motion at different speeds. The bilinear analysis of temporally-aligned shape sequences decomposes dynamic motion into time-invariant shape style factors and time-dependent motion factors. We extend the bilinear model into a tensor shape model, a multilinear decomposition of dynamic shape sequences for view-invariant shape style representations. The shape style is a view-invariant, time-invariant, and speed-invariant shape signature and is used as a feature vector for human identification. The shape style can be adapted to new environmental conditions by iterative estimation of style and content factors to reflect new observation conditions. We present the experimental results of gait recognition using the CMU Mobo gait database and the USF gait challenging database.

Original languageEnglish (US)
Pages (from-to)1133-1157
Number of pages25
JournalInternational Journal of Pattern Recognition and Artificial Intelligence
Volume24
Issue number7
DOIs
StatePublished - Nov 1 2010

All Science Journal Classification (ASJC) codes

  • Software
  • Artificial Intelligence
  • Computer Vision and Pattern Recognition

Keywords

  • Biometrics
  • dynamic shape models
  • gait recognition
  • generative models
  • robust pattern analysis
  • tensor analysis

Fingerprint Dive into the research topics of 'Dynamic shape style analysis: Bilinear and multilinear human identification with temporal normalization'. Together they form a unique fingerprint.

  • Cite this