Motion Capture from Body-Mounted Cameras

Takaaki Shiratori, Leonid Sigal, Jessica K. Hodginsy, Hyun Soo Park, Yaser Sheikhy, Jessica K. Hodginsy

Research output: Contribution to journalArticlepeer-review

15 Scopus citations


Motion capture technology generally requires that recordings be performed in a laboratory or closed stage setting with controlled lighting. This restriction precludes the capture of motions that require an outdoor setting or the traversal of large areas. In this paper, we present the theory and practice of using body-mounted cameras to reconstruct the motion of a subject. Outward-looking cameras are attached to the limbs of the subject, and the joint angles and root pose are estimated through non-linear optimization. The optimization objective function incorporates terms for image matching error and temporal continuity of motion. Structure-from-motion is used to estimate the skeleton structure and to provide initialization for the non-linear optimization procedure. Global motion is estimated and drift is controlled by matching the captured set of videos to reference imagery. We show results in settings where capture would be difficult or impossible with traditional motion capture systems, including walking outside and swinging on monkey bars. The quality of the motion reconstruction is evaluated by comparing our results against motion capture data produced by a commercially available optical system.

Original languageEnglish (US)
Pages (from-to)1-10
Number of pages10
JournalACM Transactions on Graphics
Issue number4
StatePublished - Jul 1 2011


  • Motion capture
  • articulated motion
  • structure-from-motion
  • wearable cameras


Dive into the research topics of 'Motion Capture from Body-Mounted Cameras'. Together they form a unique fingerprint.

Cite this