A challenge for 3D motion capture by monocular vision is 3D-2D projection ambiguities that may bring incorrect poses during tracking. In this paper, we propose improving 3D motion capture by learning human gesture models from a library of gestures with variants. This library has been created with virtual human animations. Gestures are described as Gaussian Process Dynamic Models (GPDM) and are used as constraints for motion tracking. Given the raw input poses from the tracker, the gesture model helps to correct ambiguous poses. The benefit of the proposed method is demonstrated with results.
Copyright 2009 Springer-Verlag. The copyright to this Contribution is transferred to Springer-Verlag GmbH Berlin Heidelberg (hereinafter called Springer-Verlag).
Springer-Verlag will take, either in its own name or in that of the Author, any necessary steps to protect these rights against infringement by third parties. It will have the copyright notice inserted into all editions of the Contribution according to the provisions of the Universal Copyright Convention (UCC) and dutifully take care of all formalities in this connection, either in its own name or in that of the Author.
PDF (536 kbytes, to be published).
- Z. Li, P. Horain, A.-M. Pez, C. Pelachaud, "Statistical Gesture Models for 3D Motion Capture from a Library of Gestures with Variants", in Gesture in Embodied Communication and Human Computer Interaction, 8th International Gesture Workshop (GW 2009), 25-27 February 2009, Bielefeld University, Revised Selected Papers, S. Kopp, I. Wachsmuth (Editors), LNCS/LNAI series, Volume no. 5934/2010, Springer-Verlag, 2010, pp. 219-230, [doi:10.1007/978-3-642-12553-9_19].
Initial abstracts (2 pages each):
- Z. Li, P. Horain, A.-M. Pez, C. Pelachaud, "Statistical gesture models for 3D motion capture", online proceedings of the 8th International Gesture Workshop (GW 2009), 25-27 February 2009, Bielefeld University.
- A.-M. Pez, C. Pelachaud, Z. Li, P. Horain, "Creating a Library of Gestures with Variants", online proceedings of the 8th International Gesture Workshop (GW 2009), 25-27 February 2009, Bielefeld University.