The appearance of dynamic scenes is often largely governed by a latent low-dimensional dynamic process. We show how to learn a mapping from video frames to this low-dimensional representation by exploiting the temporal coherence between frames and supervision from a user. This function maps the frames of the video to a low-dimensional sequence that evolves according to Markovian dynamics. This ensures that the recovered low-dimensional sequence represents a physically meaningful process. We relate our algorithm to manifold learning, semi-supervised learning, and system identification, and demonstrate it on the tasks of tracking 3D rigid objects, deformable bodies, and articulated bodies. We also show how to use the inverse of this mapping to manipulate video.
Learning appearance manifolds from video
2005-01-01
3372712 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
Video-Based Face Recognition Using Probabilistic Appearance Manifolds
British Library Conference Proceedings | 2003
|Learning Appearance and Transparency Manifolds of Occluded Objects in Layers
British Library Conference Proceedings | 2003
|