A nonintrusive system for behavioral analysis of children using multiple RGB+depth sensors

Nicholas Walczak, Joshua Fasching, William Toczyski, Ravi Sivalingam, Nathaniel Bird, Kathryn R Cullen, Vassilios Morellas, Barbara Murphy, Guillermo Sapiro, Nikolaos P Papanikolopoulos

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In developmental disorders such as autism and schizophrenia, observing behavioral precursors in very early childhood can allow for early intervention and can improve patient outcomes. While such precursors open the possibility of broad and large-scale screening, until now they have been identified only through experts' painstaking examinations and their manual annotations of limited, unprocessed video footage. Here we introduce a system to automate and assist in such procedures. Employing multiple inexpensive real-time rgb+depth (rgb+d) sensors recording from multiple viewpoints, our non-invasive systemnow installed at the Shirley G. Moore Lab School, a research preschool-is being developed to monitor and reconstruct the play and interactions of preschoolers. The system's role is to help in assessing the growing volumes of its on-site recordings and to provide the data needed to uncover additional neuromotor behavioral markers via techniques such as data mining.

Original languageEnglish (US)
Title of host publication2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012
Pages217-222
Number of pages6
DOIs
StatePublished - May 11 2012
Event2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012 - Breckenridge, CO, United States
Duration: Jan 9 2012Jan 11 2012

Other

Other2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012
CountryUnited States
CityBreckenridge, CO
Period1/9/121/11/12

Fingerprint

Data mining
Screening
Sensors

Cite this

Walczak, N., Fasching, J., Toczyski, W., Sivalingam, R., Bird, N., Cullen, K. R., ... Papanikolopoulos, N. P. (2012). A nonintrusive system for behavioral analysis of children using multiple RGB+depth sensors. In 2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012 (pp. 217-222). [6163011] https://doi.org/10.1109/WACV.2012.6163011

A nonintrusive system for behavioral analysis of children using multiple RGB+depth sensors. / Walczak, Nicholas; Fasching, Joshua; Toczyski, William; Sivalingam, Ravi; Bird, Nathaniel; Cullen, Kathryn R; Morellas, Vassilios; Murphy, Barbara; Sapiro, Guillermo; Papanikolopoulos, Nikolaos P.

2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012. 2012. p. 217-222 6163011.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Walczak, N, Fasching, J, Toczyski, W, Sivalingam, R, Bird, N, Cullen, KR, Morellas, V, Murphy, B, Sapiro, G & Papanikolopoulos, NP 2012, A nonintrusive system for behavioral analysis of children using multiple RGB+depth sensors. in 2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012., 6163011, pp. 217-222, 2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012, Breckenridge, CO, United States, 1/9/12. https://doi.org/10.1109/WACV.2012.6163011
Walczak N, Fasching J, Toczyski W, Sivalingam R, Bird N, Cullen KR et al. A nonintrusive system for behavioral analysis of children using multiple RGB+depth sensors. In 2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012. 2012. p. 217-222. 6163011 https://doi.org/10.1109/WACV.2012.6163011
Walczak, Nicholas ; Fasching, Joshua ; Toczyski, William ; Sivalingam, Ravi ; Bird, Nathaniel ; Cullen, Kathryn R ; Morellas, Vassilios ; Murphy, Barbara ; Sapiro, Guillermo ; Papanikolopoulos, Nikolaos P. / A nonintrusive system for behavioral analysis of children using multiple RGB+depth sensors. 2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012. 2012. pp. 217-222
@inproceedings{88ad8d72805e4caf91a8c53d3b3cde20,
title = "A nonintrusive system for behavioral analysis of children using multiple RGB+depth sensors",
abstract = "In developmental disorders such as autism and schizophrenia, observing behavioral precursors in very early childhood can allow for early intervention and can improve patient outcomes. While such precursors open the possibility of broad and large-scale screening, until now they have been identified only through experts' painstaking examinations and their manual annotations of limited, unprocessed video footage. Here we introduce a system to automate and assist in such procedures. Employing multiple inexpensive real-time rgb+depth (rgb+d) sensors recording from multiple viewpoints, our non-invasive systemnow installed at the Shirley G. Moore Lab School, a research preschool-is being developed to monitor and reconstruct the play and interactions of preschoolers. The system's role is to help in assessing the growing volumes of its on-site recordings and to provide the data needed to uncover additional neuromotor behavioral markers via techniques such as data mining.",
author = "Nicholas Walczak and Joshua Fasching and William Toczyski and Ravi Sivalingam and Nathaniel Bird and Cullen, {Kathryn R} and Vassilios Morellas and Barbara Murphy and Guillermo Sapiro and Papanikolopoulos, {Nikolaos P}",
year = "2012",
month = "5",
day = "11",
doi = "10.1109/WACV.2012.6163011",
language = "English (US)",
isbn = "9781467302333",
pages = "217--222",
booktitle = "2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012",

}

TY - GEN

T1 - A nonintrusive system for behavioral analysis of children using multiple RGB+depth sensors

AU - Walczak, Nicholas

AU - Fasching, Joshua

AU - Toczyski, William

AU - Sivalingam, Ravi

AU - Bird, Nathaniel

AU - Cullen, Kathryn R

AU - Morellas, Vassilios

AU - Murphy, Barbara

AU - Sapiro, Guillermo

AU - Papanikolopoulos, Nikolaos P

PY - 2012/5/11

Y1 - 2012/5/11

N2 - In developmental disorders such as autism and schizophrenia, observing behavioral precursors in very early childhood can allow for early intervention and can improve patient outcomes. While such precursors open the possibility of broad and large-scale screening, until now they have been identified only through experts' painstaking examinations and their manual annotations of limited, unprocessed video footage. Here we introduce a system to automate and assist in such procedures. Employing multiple inexpensive real-time rgb+depth (rgb+d) sensors recording from multiple viewpoints, our non-invasive systemnow installed at the Shirley G. Moore Lab School, a research preschool-is being developed to monitor and reconstruct the play and interactions of preschoolers. The system's role is to help in assessing the growing volumes of its on-site recordings and to provide the data needed to uncover additional neuromotor behavioral markers via techniques such as data mining.

AB - In developmental disorders such as autism and schizophrenia, observing behavioral precursors in very early childhood can allow for early intervention and can improve patient outcomes. While such precursors open the possibility of broad and large-scale screening, until now they have been identified only through experts' painstaking examinations and their manual annotations of limited, unprocessed video footage. Here we introduce a system to automate and assist in such procedures. Employing multiple inexpensive real-time rgb+depth (rgb+d) sensors recording from multiple viewpoints, our non-invasive systemnow installed at the Shirley G. Moore Lab School, a research preschool-is being developed to monitor and reconstruct the play and interactions of preschoolers. The system's role is to help in assessing the growing volumes of its on-site recordings and to provide the data needed to uncover additional neuromotor behavioral markers via techniques such as data mining.

UR - http://www.scopus.com/inward/record.url?scp=84860681248&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860681248&partnerID=8YFLogxK

U2 - 10.1109/WACV.2012.6163011

DO - 10.1109/WACV.2012.6163011

M3 - Conference contribution

SN - 9781467302333

SP - 217

EP - 222

BT - 2012 IEEE Workshop on the Applications of Computer Vision, WACV 2012

ER -