Motion capture from body-mounted cameras

Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, Jessica K. Hodginsy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

64 Scopus citations

Abstract

Motion capture technology generally requires that recordings be performed in a laboratory or closed stage setting with controlled lighting. This restriction precludes the capture of motions that require an outdoor setting or the traversal of large areas. In this paper, we present the theory and practice of using body-mounted cameras to reconstruct the motion of a subject. Outward-looking cameras are attached to the limbs of the subject, and the joint angles and root pose are estimated through non-linear optimization. The optimization objective function incorporates terms for image matching error and temporal continuity of motion. Structure-from-motion is used to estimate the skeleton structure and to provide initialization for the non-linear optimization procedure. Global motion is estimated and drift is controlled by matching the captured set of videos to reference imagery. We show results in settings where capture would be difficult or impossible with traditional motion capture systems, including walking outside and swinging on monkey bars. The quality of the motion reconstruction is evaluated by comparing our results against motion capture data produced by a commercially available optical system.

Original languageEnglish (US)
Title of host publicationProceedings of ACM SIGGRAPH 2011, SIGGRAPH 2011
Volume30
Edition4
DOIs
StatePublished - Jul 1 2011
EventACM SIGGRAPH 2011, SIGGRAPH 2011 - Vancouver, BC, Canada
Duration: Aug 7 2011Aug 11 2011

Other

OtherACM SIGGRAPH 2011, SIGGRAPH 2011
CountryCanada
CityVancouver, BC
Period8/7/118/11/11

Keywords

  • Articulated motion
  • Motion capture
  • Structure-from-motion
  • Wearable cameras

Fingerprint Dive into the research topics of 'Motion capture from body-mounted cameras'. Together they form a unique fingerprint.

Cite this