Automated coding of activity videos from an OCD study

Joshua Fasching, Nicholas Walczak, Gail A Bernstein, Tasoulla Hadjiyanni, Kathryn R Cullen, Vassilios Morellas, Nikolaos P Papanikolopoulos

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Analysis of behavior using video is a promising approach for identifying risk markers for psychopathology that can be applied in a wide range of populations. Computer vision techniques are needed to automatically code behavior in order to reduce time and effort in these analyses. This paper discusses algorithms developed for the automatic analysis of video data from a study regarding the impact of environmental factors on youths with obsessive-compulsive disorder. Overhead videos of subjects washing hands were automatically annotated for activities such as rinsing, applying soap, and turning on/off the water faucet. These automated annotations were created by using a color-based background subtraction method to create a foreground probability score which is then used to determine if various labeled regions of interest (ROIs) are activated. These activation signals are then characterized and used to determine when different substeps of the handwashing procedure are performed. Automated annotations were validated by comparisons with hand-labeled ground truth.

Original languageEnglish (US)
Title of host publication2016 IEEE International Conference on Robotics and Automation, ICRA 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages5638-5643
Number of pages6
ISBN (Electronic)9781467380263
DOIs
StatePublished - Jun 8 2016
Event2016 IEEE International Conference on Robotics and Automation, ICRA 2016 - Stockholm, Sweden
Duration: May 16 2016May 21 2016

Publication series

NameProceedings - IEEE International Conference on Robotics and Automation
Volume2016-June
ISSN (Print)1050-4729

Other

Other2016 IEEE International Conference on Robotics and Automation, ICRA 2016
CountrySweden
CityStockholm
Period5/16/165/21/16

Fingerprint

Soaps (detergents)
Washing
Computer vision
Chemical activation
Color
Water

Cite this

Fasching, J., Walczak, N., Bernstein, G. A., Hadjiyanni, T., Cullen, K. R., Morellas, V., & Papanikolopoulos, N. P. (2016). Automated coding of activity videos from an OCD study. In 2016 IEEE International Conference on Robotics and Automation, ICRA 2016 (pp. 5638-5643). [7487783] (Proceedings - IEEE International Conference on Robotics and Automation; Vol. 2016-June). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICRA.2016.7487783

Automated coding of activity videos from an OCD study. / Fasching, Joshua; Walczak, Nicholas; Bernstein, Gail A; Hadjiyanni, Tasoulla; Cullen, Kathryn R; Morellas, Vassilios; Papanikolopoulos, Nikolaos P.

2016 IEEE International Conference on Robotics and Automation, ICRA 2016. Institute of Electrical and Electronics Engineers Inc., 2016. p. 5638-5643 7487783 (Proceedings - IEEE International Conference on Robotics and Automation; Vol. 2016-June).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fasching, J, Walczak, N, Bernstein, GA, Hadjiyanni, T, Cullen, KR, Morellas, V & Papanikolopoulos, NP 2016, Automated coding of activity videos from an OCD study. in 2016 IEEE International Conference on Robotics and Automation, ICRA 2016., 7487783, Proceedings - IEEE International Conference on Robotics and Automation, vol. 2016-June, Institute of Electrical and Electronics Engineers Inc., pp. 5638-5643, 2016 IEEE International Conference on Robotics and Automation, ICRA 2016, Stockholm, Sweden, 5/16/16. https://doi.org/10.1109/ICRA.2016.7487783
Fasching J, Walczak N, Bernstein GA, Hadjiyanni T, Cullen KR, Morellas V et al. Automated coding of activity videos from an OCD study. In 2016 IEEE International Conference on Robotics and Automation, ICRA 2016. Institute of Electrical and Electronics Engineers Inc. 2016. p. 5638-5643. 7487783. (Proceedings - IEEE International Conference on Robotics and Automation). https://doi.org/10.1109/ICRA.2016.7487783
Fasching, Joshua ; Walczak, Nicholas ; Bernstein, Gail A ; Hadjiyanni, Tasoulla ; Cullen, Kathryn R ; Morellas, Vassilios ; Papanikolopoulos, Nikolaos P. / Automated coding of activity videos from an OCD study. 2016 IEEE International Conference on Robotics and Automation, ICRA 2016. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 5638-5643 (Proceedings - IEEE International Conference on Robotics and Automation).
@inproceedings{ed5e815fed994495ba85a5b5ea30b6ab,
title = "Automated coding of activity videos from an OCD study",
abstract = "Analysis of behavior using video is a promising approach for identifying risk markers for psychopathology that can be applied in a wide range of populations. Computer vision techniques are needed to automatically code behavior in order to reduce time and effort in these analyses. This paper discusses algorithms developed for the automatic analysis of video data from a study regarding the impact of environmental factors on youths with obsessive-compulsive disorder. Overhead videos of subjects washing hands were automatically annotated for activities such as rinsing, applying soap, and turning on/off the water faucet. These automated annotations were created by using a color-based background subtraction method to create a foreground probability score which is then used to determine if various labeled regions of interest (ROIs) are activated. These activation signals are then characterized and used to determine when different substeps of the handwashing procedure are performed. Automated annotations were validated by comparisons with hand-labeled ground truth.",
author = "Joshua Fasching and Nicholas Walczak and Bernstein, {Gail A} and Tasoulla Hadjiyanni and Cullen, {Kathryn R} and Vassilios Morellas and Papanikolopoulos, {Nikolaos P}",
year = "2016",
month = "6",
day = "8",
doi = "10.1109/ICRA.2016.7487783",
language = "English (US)",
series = "Proceedings - IEEE International Conference on Robotics and Automation",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "5638--5643",
booktitle = "2016 IEEE International Conference on Robotics and Automation, ICRA 2016",

}

TY - GEN

T1 - Automated coding of activity videos from an OCD study

AU - Fasching, Joshua

AU - Walczak, Nicholas

AU - Bernstein, Gail A

AU - Hadjiyanni, Tasoulla

AU - Cullen, Kathryn R

AU - Morellas, Vassilios

AU - Papanikolopoulos, Nikolaos P

PY - 2016/6/8

Y1 - 2016/6/8

N2 - Analysis of behavior using video is a promising approach for identifying risk markers for psychopathology that can be applied in a wide range of populations. Computer vision techniques are needed to automatically code behavior in order to reduce time and effort in these analyses. This paper discusses algorithms developed for the automatic analysis of video data from a study regarding the impact of environmental factors on youths with obsessive-compulsive disorder. Overhead videos of subjects washing hands were automatically annotated for activities such as rinsing, applying soap, and turning on/off the water faucet. These automated annotations were created by using a color-based background subtraction method to create a foreground probability score which is then used to determine if various labeled regions of interest (ROIs) are activated. These activation signals are then characterized and used to determine when different substeps of the handwashing procedure are performed. Automated annotations were validated by comparisons with hand-labeled ground truth.

AB - Analysis of behavior using video is a promising approach for identifying risk markers for psychopathology that can be applied in a wide range of populations. Computer vision techniques are needed to automatically code behavior in order to reduce time and effort in these analyses. This paper discusses algorithms developed for the automatic analysis of video data from a study regarding the impact of environmental factors on youths with obsessive-compulsive disorder. Overhead videos of subjects washing hands were automatically annotated for activities such as rinsing, applying soap, and turning on/off the water faucet. These automated annotations were created by using a color-based background subtraction method to create a foreground probability score which is then used to determine if various labeled regions of interest (ROIs) are activated. These activation signals are then characterized and used to determine when different substeps of the handwashing procedure are performed. Automated annotations were validated by comparisons with hand-labeled ground truth.

UR - http://www.scopus.com/inward/record.url?scp=84977581462&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84977581462&partnerID=8YFLogxK

U2 - 10.1109/ICRA.2016.7487783

DO - 10.1109/ICRA.2016.7487783

M3 - Conference contribution

T3 - Proceedings - IEEE International Conference on Robotics and Automation

SP - 5638

EP - 5643

BT - 2016 IEEE International Conference on Robotics and Automation, ICRA 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -