A computer vision approach for the assessment of autism-related behavioral markers

Jordan Hashemi, Thiago Vallin Spina, Mariano Tepper, Amy N Esler, Vassilios Morellas, Nikolaos P Papanikolopoulos, Guillermo Sapiro

Research output: Chapter in Book/Report/Conference proceedingConference contribution

19 Citations (Scopus)

Abstract

The early detection of developmental disorders is key to child outcome, allowing interventions to be initiated that promote development and improve prognosis. Research on autism spectrum disorder (ASD) suggests behavioral markers can be observed late in the first year of life. Many of these studies involved extensive frame-by-frame video observation and analysis of a child's natural behavior. Although non-intrusive, these methods are extremely time-intensive and require a high level of observer training; thus, they are impractical for clinical purposes. Diagnostic measures for ASD are available for infants but are only accurate when used by specialists experienced in early diagnosis. This work is a first milestone in a long-term multidisciplinary project that aims at helping clinicians and general practitioners accomplish this early detection/measurement task automatically. We focus on providing computer vision tools to measure and identify ASD behavioral markers based on components of the Autism Observation Scale for Infants (AOSI). In particular, we develop algorithms to measure three critical AOSI activities that assess visual attention. We augment these AOSI activities with an additional test that analyzes asymmetrical patterns in unsupported gait. The first set of algorithms involves assessing head motion by facial feature tracking, while the gait analysis relies on joint foreground segmentation and 2D body pose estimation in video. We show results that provide insightful knowledge to augment the clinician's behavioral observations obtained from real in-clinic assessments.

Original languageEnglish (US)
Title of host publication2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012
DOIs
StatePublished - Dec 1 2012
Event2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012 - "San Diego,CA", United States
Duration: Nov 7 2012Nov 9 2012

Other

Other2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012
CountryUnited States
City"San Diego,CA"
Period11/7/1211/9/12

Fingerprint

Computer vision
Gait analysis

Cite this

Hashemi, J., Spina, T. V., Tepper, M., Esler, A. N., Morellas, V., Papanikolopoulos, N. P., & Sapiro, G. (2012). A computer vision approach for the assessment of autism-related behavioral markers. In 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012 [6400865] https://doi.org/10.1109/DevLrn.2012.6400865

A computer vision approach for the assessment of autism-related behavioral markers. / Hashemi, Jordan; Spina, Thiago Vallin; Tepper, Mariano; Esler, Amy N; Morellas, Vassilios; Papanikolopoulos, Nikolaos P; Sapiro, Guillermo.

2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012. 2012. 6400865.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hashemi, J, Spina, TV, Tepper, M, Esler, AN, Morellas, V, Papanikolopoulos, NP & Sapiro, G 2012, A computer vision approach for the assessment of autism-related behavioral markers. in 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012., 6400865, 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012, "San Diego,CA", United States, 11/7/12. https://doi.org/10.1109/DevLrn.2012.6400865
Hashemi J, Spina TV, Tepper M, Esler AN, Morellas V, Papanikolopoulos NP et al. A computer vision approach for the assessment of autism-related behavioral markers. In 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012. 2012. 6400865 https://doi.org/10.1109/DevLrn.2012.6400865
Hashemi, Jordan ; Spina, Thiago Vallin ; Tepper, Mariano ; Esler, Amy N ; Morellas, Vassilios ; Papanikolopoulos, Nikolaos P ; Sapiro, Guillermo. / A computer vision approach for the assessment of autism-related behavioral markers. 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012. 2012.
@inproceedings{25957d5e946c4969b39f73d2ff816826,
title = "A computer vision approach for the assessment of autism-related behavioral markers",
abstract = "The early detection of developmental disorders is key to child outcome, allowing interventions to be initiated that promote development and improve prognosis. Research on autism spectrum disorder (ASD) suggests behavioral markers can be observed late in the first year of life. Many of these studies involved extensive frame-by-frame video observation and analysis of a child's natural behavior. Although non-intrusive, these methods are extremely time-intensive and require a high level of observer training; thus, they are impractical for clinical purposes. Diagnostic measures for ASD are available for infants but are only accurate when used by specialists experienced in early diagnosis. This work is a first milestone in a long-term multidisciplinary project that aims at helping clinicians and general practitioners accomplish this early detection/measurement task automatically. We focus on providing computer vision tools to measure and identify ASD behavioral markers based on components of the Autism Observation Scale for Infants (AOSI). In particular, we develop algorithms to measure three critical AOSI activities that assess visual attention. We augment these AOSI activities with an additional test that analyzes asymmetrical patterns in unsupported gait. The first set of algorithms involves assessing head motion by facial feature tracking, while the gait analysis relies on joint foreground segmentation and 2D body pose estimation in video. We show results that provide insightful knowledge to augment the clinician's behavioral observations obtained from real in-clinic assessments.",
author = "Jordan Hashemi and Spina, {Thiago Vallin} and Mariano Tepper and Esler, {Amy N} and Vassilios Morellas and Papanikolopoulos, {Nikolaos P} and Guillermo Sapiro",
year = "2012",
month = "12",
day = "1",
doi = "10.1109/DevLrn.2012.6400865",
language = "English (US)",
isbn = "9781467349635",
booktitle = "2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012",

}

TY - GEN

T1 - A computer vision approach for the assessment of autism-related behavioral markers

AU - Hashemi, Jordan

AU - Spina, Thiago Vallin

AU - Tepper, Mariano

AU - Esler, Amy N

AU - Morellas, Vassilios

AU - Papanikolopoulos, Nikolaos P

AU - Sapiro, Guillermo

PY - 2012/12/1

Y1 - 2012/12/1

N2 - The early detection of developmental disorders is key to child outcome, allowing interventions to be initiated that promote development and improve prognosis. Research on autism spectrum disorder (ASD) suggests behavioral markers can be observed late in the first year of life. Many of these studies involved extensive frame-by-frame video observation and analysis of a child's natural behavior. Although non-intrusive, these methods are extremely time-intensive and require a high level of observer training; thus, they are impractical for clinical purposes. Diagnostic measures for ASD are available for infants but are only accurate when used by specialists experienced in early diagnosis. This work is a first milestone in a long-term multidisciplinary project that aims at helping clinicians and general practitioners accomplish this early detection/measurement task automatically. We focus on providing computer vision tools to measure and identify ASD behavioral markers based on components of the Autism Observation Scale for Infants (AOSI). In particular, we develop algorithms to measure three critical AOSI activities that assess visual attention. We augment these AOSI activities with an additional test that analyzes asymmetrical patterns in unsupported gait. The first set of algorithms involves assessing head motion by facial feature tracking, while the gait analysis relies on joint foreground segmentation and 2D body pose estimation in video. We show results that provide insightful knowledge to augment the clinician's behavioral observations obtained from real in-clinic assessments.

AB - The early detection of developmental disorders is key to child outcome, allowing interventions to be initiated that promote development and improve prognosis. Research on autism spectrum disorder (ASD) suggests behavioral markers can be observed late in the first year of life. Many of these studies involved extensive frame-by-frame video observation and analysis of a child's natural behavior. Although non-intrusive, these methods are extremely time-intensive and require a high level of observer training; thus, they are impractical for clinical purposes. Diagnostic measures for ASD are available for infants but are only accurate when used by specialists experienced in early diagnosis. This work is a first milestone in a long-term multidisciplinary project that aims at helping clinicians and general practitioners accomplish this early detection/measurement task automatically. We focus on providing computer vision tools to measure and identify ASD behavioral markers based on components of the Autism Observation Scale for Infants (AOSI). In particular, we develop algorithms to measure three critical AOSI activities that assess visual attention. We augment these AOSI activities with an additional test that analyzes asymmetrical patterns in unsupported gait. The first set of algorithms involves assessing head motion by facial feature tracking, while the gait analysis relies on joint foreground segmentation and 2D body pose estimation in video. We show results that provide insightful knowledge to augment the clinician's behavioral observations obtained from real in-clinic assessments.

UR - http://www.scopus.com/inward/record.url?scp=84872844561&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84872844561&partnerID=8YFLogxK

U2 - 10.1109/DevLrn.2012.6400865

DO - 10.1109/DevLrn.2012.6400865

M3 - Conference contribution

SN - 9781467349635

BT - 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012

ER -