Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth

Ming Jiang; Sunday Francis; Angela Tseng; Diksha Srishyla; Megan Dubois; Katie Beard; Christine A Conelea; Qi Zhao; Suma Jacob

doi:10.1109/EMBC44109.2020.9176843

Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth

Ming Jiang
, Sunday Francis
, Angela Tseng
, Diksha Srishyla
, Megan Dubois
, Katie Beard
, Christine A Conelea
, Qi Zhao
, Suma Jacob

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

21 Scopus citations

Abstract

Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder (NDD) with a high rate of comorbidity. The implementation of eye-tracking methodologies has informed behavioral and neurophysiological patterns of visual processing across ASD and comorbid NDDs. In this study, we propose a machine learning method to predict measures of two core ASD characteristics: impaired social interactions and communication, and restricted, repetitive, and stereotyped behaviors and interests. Our method extracts behavioral features from task performance and eye-tracking data collected during a facial emotion recognition paradigm. We achieved high regression accuracy using a Random Forest regressor trained to predict scores on the SRS-2 and RBS-R assessments; this approach may serve as a classifier for ASD diagnosis.

Original language	English (US)
Title of host publication	42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
Subtitle of host publication	Enabling Innovative Technologies for Global Healthcare, EMBC 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	871-875
Number of pages	5
Volume	2020
ISBN (Electronic)	9781728119908
DOIs	https://doi.org/10.1109/EMBC44109.2020.9176843
State	Published - Jul 2020
Event	42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 - Montreal, Canada Duration: Jul 20 2020 → Jul 24 2020

Publication series

Name	Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume	2020-July
ISSN (Print)	1557-170X

Conference

Conference	42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020
Country/Territory	Canada
City	Montreal
Period	7/20/20 → 7/24/20

Bibliographical note

Publisher Copyright:
© 2020 IEEE.

Keywords

Adolescent
Autism Spectrum Disorder/diagnosis
Emotions
Face
Facial Recognition
Humans
Social Communication Disorder

PubMed: MeSH publication types

Journal Article

Publisher link

10.1109/EMBC44109.2020.9176843

Find It

Find It at U of M Libraries

Cite this

Jiang, M., Francis, S., Tseng, A., Srishyla, D., Dubois, M., Beard, K., Conelea, C. A., Zhao, Q., & Jacob, S. (2020). Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. In 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020 (Vol. 2020, pp. 871-875). Article 9176843 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2020-July). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC44109.2020.9176843

Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. / Jiang, Ming; Francis, Sunday; Tseng, Angela et al.
42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020. Vol. 2020 Institute of Electrical and Electronics Engineers Inc., 2020. p. 871-875 9176843 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2020-July).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Jiang, M, Francis, S, Tseng, A, Srishyla, D, Dubois, M, Beard, K, Conelea, CA , Zhao, Q & Jacob, S 2020, Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. in 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020. vol. 2020, 9176843, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, vol. 2020-July, Institute of Electrical and Electronics Engineers Inc., pp. 871-875, 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020, Montreal, Canada, 7/20/20. https://doi.org/10.1109/EMBC44109.2020.9176843

Jiang M, Francis S, Tseng A, Srishyla D, Dubois M, Beard K et al. Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. In 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020. Vol. 2020. Institute of Electrical and Electronics Engineers Inc. 2020. p. 871-875. 9176843. (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS). doi: 10.1109/EMBC44109.2020.9176843

Jiang, Ming ; Francis, Sunday ; Tseng, Angela et al. / Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020. Vol. 2020 Institute of Electrical and Electronics Engineers Inc., 2020. pp. 871-875 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS).

@inproceedings{643aa45f884942f58a9c3b997a4e0266,

title = "Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth",

abstract = "Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder (NDD) with a high rate of comorbidity. The implementation of eye-tracking methodologies has informed behavioral and neurophysiological patterns of visual processing across ASD and comorbid NDDs. In this study, we propose a machine learning method to predict measures of two core ASD characteristics: impaired social interactions and communication, and restricted, repetitive, and stereotyped behaviors and interests. Our method extracts behavioral features from task performance and eye-tracking data collected during a facial emotion recognition paradigm. We achieved high regression accuracy using a Random Forest regressor trained to predict scores on the SRS-2 and RBS-R assessments; this approach may serve as a classifier for ASD diagnosis.",

keywords = "Adolescent, Autism Spectrum Disorder/diagnosis, Emotions, Face, Facial Recognition, Humans, Social Communication Disorder",

author = "Ming Jiang and Sunday Francis and Angela Tseng and Diksha Srishyla and Megan Dubois and Katie Beard and Conelea, \{Christine A\} and Qi Zhao and Suma Jacob",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 ; Conference date: 20-07-2020 Through 24-07-2020",

year = "2020",

month = jul,

doi = "10.1109/EMBC44109.2020.9176843",

language = "English (US)",

volume = "2020",

series = "Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "871--875",

booktitle = "42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society",

}

TY - GEN

T1 - Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth

AU - Jiang, Ming

AU - Francis, Sunday

AU - Tseng, Angela

AU - Srishyla, Diksha

AU - Dubois, Megan

AU - Beard, Katie

AU - Conelea, Christine A

AU - Zhao, Qi

AU - Jacob, Suma

PY - 2020/7

Y1 - 2020/7

N2 - Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder (NDD) with a high rate of comorbidity. The implementation of eye-tracking methodologies has informed behavioral and neurophysiological patterns of visual processing across ASD and comorbid NDDs. In this study, we propose a machine learning method to predict measures of two core ASD characteristics: impaired social interactions and communication, and restricted, repetitive, and stereotyped behaviors and interests. Our method extracts behavioral features from task performance and eye-tracking data collected during a facial emotion recognition paradigm. We achieved high regression accuracy using a Random Forest regressor trained to predict scores on the SRS-2 and RBS-R assessments; this approach may serve as a classifier for ASD diagnosis.

AB - Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder (NDD) with a high rate of comorbidity. The implementation of eye-tracking methodologies has informed behavioral and neurophysiological patterns of visual processing across ASD and comorbid NDDs. In this study, we propose a machine learning method to predict measures of two core ASD characteristics: impaired social interactions and communication, and restricted, repetitive, and stereotyped behaviors and interests. Our method extracts behavioral features from task performance and eye-tracking data collected during a facial emotion recognition paradigm. We achieved high regression accuracy using a Random Forest regressor trained to predict scores on the SRS-2 and RBS-R assessments; this approach may serve as a classifier for ASD diagnosis.

KW - Adolescent

KW - Autism Spectrum Disorder/diagnosis

KW - Emotions

KW - Face

KW - Facial Recognition

KW - Humans

KW - Social Communication Disorder

UR - https://www.scopus.com/pages/publications/85091001196

UR - https://www.scopus.com/pages/publications/85091001196#tab=citedBy

U2 - 10.1109/EMBC44109.2020.9176843

DO - 10.1109/EMBC44109.2020.9176843

M3 - Conference contribution

C2 - 33018123

AN - SCOPUS:85091001196

VL - 2020

T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

SP - 871

EP - 875

BT - 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020

Y2 - 20 July 2020 through 24 July 2020

ER -

Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth

Abstract

Publication series

Conference

Bibliographical note

Keywords

PubMed: MeSH publication types

Publisher link

Find It

Other files and links

Fingerprint

Cite this