A multi-sensor visual tracking system for behavior monitoring of at-risk children

Ravishankar Sivalingam, Anoop Cherian, Joshua Fasching, Nicholas Walczak, Nathaniel Bird, Vassilios Morellas, Barbara Murphy, Kathryn R Cullen, Kelvin O Lim, Guillermo Sapiro, Nikolaos P Papanikolopoulos

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)

Abstract

Clinical studies confirm that mental illnesses such as autism, Obsessive Compulsive Disorder (OCD), etc. show behavioral abnormalities even at very young ages; the early diagnosis of which can help steer effective treatments. Most often, the behavior of such at-risk children deviate in very subtle ways from that of a normal child; correct diagnosis of which requires prolonged and continuous monitoring of their activities by a clinician, which is a difficult and time intensive task. As a result, the development of automation tools for assisting in such monitoring activities will be an important step towards effective utilization of the diagnostic resources. In this paper, we approach the problem from a computer vision standpoint, and propose a novel system for the automatic monitoring of the behavior of children in their natural environment through the deployment of multiple non-invasive sensors (cameras and depth sensors). We provide details of our system, together with algorithms for the robust tracking of the activities of the children. Our experiments, conducted in the Shirley G. Moore Laboratory School, demonstrate the effectiveness of our methodology.

Original languageEnglish (US)
Title of host publication2012 IEEE International Conference on Robotics and Automation, ICRA 2012
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1345-1350
Number of pages6
ISBN (Print)9781467314039
DOIs
StatePublished - Jan 1 2012
Event 2012 IEEE International Conference on Robotics and Automation, ICRA 2012 - Saint Paul, MN, United States
Duration: May 14 2012May 18 2012

Other

Other 2012 IEEE International Conference on Robotics and Automation, ICRA 2012
CountryUnited States
CitySaint Paul, MN
Period5/14/125/18/12

Fingerprint

Monitoring
Sensors
Computer vision
Automation
Cameras
Experiments

Cite this

Sivalingam, R., Cherian, A., Fasching, J., Walczak, N., Bird, N., Morellas, V., ... Papanikolopoulos, N. P. (2012). A multi-sensor visual tracking system for behavior monitoring of at-risk children. In 2012 IEEE International Conference on Robotics and Automation, ICRA 2012 (pp. 1345-1350). [6225280] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICRA.2012.6225280

A multi-sensor visual tracking system for behavior monitoring of at-risk children. / Sivalingam, Ravishankar; Cherian, Anoop; Fasching, Joshua; Walczak, Nicholas; Bird, Nathaniel; Morellas, Vassilios; Murphy, Barbara; Cullen, Kathryn R; Lim, Kelvin O; Sapiro, Guillermo; Papanikolopoulos, Nikolaos P.

2012 IEEE International Conference on Robotics and Automation, ICRA 2012. Institute of Electrical and Electronics Engineers Inc., 2012. p. 1345-1350 6225280.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sivalingam, R, Cherian, A, Fasching, J, Walczak, N, Bird, N, Morellas, V, Murphy, B, Cullen, KR, Lim, KO, Sapiro, G & Papanikolopoulos, NP 2012, A multi-sensor visual tracking system for behavior monitoring of at-risk children. in 2012 IEEE International Conference on Robotics and Automation, ICRA 2012., 6225280, Institute of Electrical and Electronics Engineers Inc., pp. 1345-1350, 2012 IEEE International Conference on Robotics and Automation, ICRA 2012, Saint Paul, MN, United States, 5/14/12. https://doi.org/10.1109/ICRA.2012.6225280
Sivalingam R, Cherian A, Fasching J, Walczak N, Bird N, Morellas V et al. A multi-sensor visual tracking system for behavior monitoring of at-risk children. In 2012 IEEE International Conference on Robotics and Automation, ICRA 2012. Institute of Electrical and Electronics Engineers Inc. 2012. p. 1345-1350. 6225280 https://doi.org/10.1109/ICRA.2012.6225280
Sivalingam, Ravishankar ; Cherian, Anoop ; Fasching, Joshua ; Walczak, Nicholas ; Bird, Nathaniel ; Morellas, Vassilios ; Murphy, Barbara ; Cullen, Kathryn R ; Lim, Kelvin O ; Sapiro, Guillermo ; Papanikolopoulos, Nikolaos P. / A multi-sensor visual tracking system for behavior monitoring of at-risk children. 2012 IEEE International Conference on Robotics and Automation, ICRA 2012. Institute of Electrical and Electronics Engineers Inc., 2012. pp. 1345-1350
@inproceedings{b98da3b714c2426a99a06c8915a1f2d5,
title = "A multi-sensor visual tracking system for behavior monitoring of at-risk children",
abstract = "Clinical studies confirm that mental illnesses such as autism, Obsessive Compulsive Disorder (OCD), etc. show behavioral abnormalities even at very young ages; the early diagnosis of which can help steer effective treatments. Most often, the behavior of such at-risk children deviate in very subtle ways from that of a normal child; correct diagnosis of which requires prolonged and continuous monitoring of their activities by a clinician, which is a difficult and time intensive task. As a result, the development of automation tools for assisting in such monitoring activities will be an important step towards effective utilization of the diagnostic resources. In this paper, we approach the problem from a computer vision standpoint, and propose a novel system for the automatic monitoring of the behavior of children in their natural environment through the deployment of multiple non-invasive sensors (cameras and depth sensors). We provide details of our system, together with algorithms for the robust tracking of the activities of the children. Our experiments, conducted in the Shirley G. Moore Laboratory School, demonstrate the effectiveness of our methodology.",
author = "Ravishankar Sivalingam and Anoop Cherian and Joshua Fasching and Nicholas Walczak and Nathaniel Bird and Vassilios Morellas and Barbara Murphy and Cullen, {Kathryn R} and Lim, {Kelvin O} and Guillermo Sapiro and Papanikolopoulos, {Nikolaos P}",
year = "2012",
month = "1",
day = "1",
doi = "10.1109/ICRA.2012.6225280",
language = "English (US)",
isbn = "9781467314039",
pages = "1345--1350",
booktitle = "2012 IEEE International Conference on Robotics and Automation, ICRA 2012",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - A multi-sensor visual tracking system for behavior monitoring of at-risk children

AU - Sivalingam, Ravishankar

AU - Cherian, Anoop

AU - Fasching, Joshua

AU - Walczak, Nicholas

AU - Bird, Nathaniel

AU - Morellas, Vassilios

AU - Murphy, Barbara

AU - Cullen, Kathryn R

AU - Lim, Kelvin O

AU - Sapiro, Guillermo

AU - Papanikolopoulos, Nikolaos P

PY - 2012/1/1

Y1 - 2012/1/1

N2 - Clinical studies confirm that mental illnesses such as autism, Obsessive Compulsive Disorder (OCD), etc. show behavioral abnormalities even at very young ages; the early diagnosis of which can help steer effective treatments. Most often, the behavior of such at-risk children deviate in very subtle ways from that of a normal child; correct diagnosis of which requires prolonged and continuous monitoring of their activities by a clinician, which is a difficult and time intensive task. As a result, the development of automation tools for assisting in such monitoring activities will be an important step towards effective utilization of the diagnostic resources. In this paper, we approach the problem from a computer vision standpoint, and propose a novel system for the automatic monitoring of the behavior of children in their natural environment through the deployment of multiple non-invasive sensors (cameras and depth sensors). We provide details of our system, together with algorithms for the robust tracking of the activities of the children. Our experiments, conducted in the Shirley G. Moore Laboratory School, demonstrate the effectiveness of our methodology.

AB - Clinical studies confirm that mental illnesses such as autism, Obsessive Compulsive Disorder (OCD), etc. show behavioral abnormalities even at very young ages; the early diagnosis of which can help steer effective treatments. Most often, the behavior of such at-risk children deviate in very subtle ways from that of a normal child; correct diagnosis of which requires prolonged and continuous monitoring of their activities by a clinician, which is a difficult and time intensive task. As a result, the development of automation tools for assisting in such monitoring activities will be an important step towards effective utilization of the diagnostic resources. In this paper, we approach the problem from a computer vision standpoint, and propose a novel system for the automatic monitoring of the behavior of children in their natural environment through the deployment of multiple non-invasive sensors (cameras and depth sensors). We provide details of our system, together with algorithms for the robust tracking of the activities of the children. Our experiments, conducted in the Shirley G. Moore Laboratory School, demonstrate the effectiveness of our methodology.

UR - http://www.scopus.com/inward/record.url?scp=84864453052&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84864453052&partnerID=8YFLogxK

U2 - 10.1109/ICRA.2012.6225280

DO - 10.1109/ICRA.2012.6225280

M3 - Conference contribution

SN - 9781467314039

SP - 1345

EP - 1350

BT - 2012 IEEE International Conference on Robotics and Automation, ICRA 2012

PB - Institute of Electrical and Electronics Engineers Inc.

ER -