Deep neural networks enable quantitative movement analysis using single-camera videos

Łukasz Kidziński, Bryan Yang, Jennifer L. Hicks, Apoorva Rajagopal, Scott L. Delp, Michael H. Schwartz

Research output: Contribution to journalArticlepeer-review

117 Scopus citations


Many neurological and musculoskeletal diseases impair movement, which limits people’s function and social participation. Quantitative assessment of motion is critical to medical decision-making but is currently possible only with expensive motion capture systems and highly trained personnel. Here, we present a method for predicting clinically relevant motion parameters from an ordinary video of a patient. Our machine learning models predict parameters include walking speed (r = 0.73), cadence (r = 0.79), knee flexion angle at maximum extension (r = 0.83), and Gait Deviation Index (GDI), a comprehensive metric of gait impairment (r = 0.75). These correlation values approach the theoretical limits for accuracy imposed by natural variability in these metrics within our patient population. Our methods for quantifying gait pathology with commodity cameras increase access to quantitative motion analysis in clinics and at home and enable researchers to conduct large-scale studies of neurological and musculoskeletal disorders.

Original languageEnglish (US)
Article number4054
JournalNature communications
Issue number1
StatePublished - Aug 13 2020

Bibliographical note

Publisher Copyright:
© 2020, This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply.


  • Electronic Data Processing
  • Female
  • Gait/physiology
  • Humans
  • Machine Learning
  • Male
  • Neural Networks, Computer
  • Walking/physiology

PubMed: MeSH publication types

  • Journal Article
  • Research Support, N.I.H., Extramural


Dive into the research topics of 'Deep neural networks enable quantitative movement analysis using single-camera videos'. Together they form a unique fingerprint.

Cite this