Real-time detection of food consumption activities using wearable wireless sensors

Gregory Johnson, Yan Wang, Rajesh Rajamani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper addresses research challenges associated with development of a wearable sensor system for detecting the food consumption activities of a subject. The objective is to automatically detect the occurrence of food consumption whenever it occurs, in order to use this activity detection to record a representative camera image of the food and count the number of bites of food consumed. The wearable system consists of two elastic bands - one each on the upper arm and wrist - instrumented with wireless inertial and magnetic sensors. Two major technical challenges include i) singularity issues with Euler angle estimation due to arm rotations that can exceed 90 degrees, and ii) the need to differentiate between eating and non-eating activities involving close hand-mouth proximity. The singularity challenge is addressed by using a direction cosine matrix estimation technique that utilizes a linear Kalman Filter. The differentiation between eating and non-eating activities is done using a support-vector-machine (SVM) based machine learning algorithm. Experimental results using wearable prototype bands show that both the DCM estimation and machine learning components work reliably and have the potential to be useful for home-based automated food intake detection.

Original languageEnglish (US)
Title of host publication2019 American Control Conference, ACC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3450-3455
Number of pages6
ISBN (Electronic)9781538679265
StatePublished - Jul 2019
Event2019 American Control Conference, ACC 2019 - Philadelphia, United States
Duration: Jul 10 2019Jul 12 2019

Publication series

NameProceedings of the American Control Conference
Volume2019-July
ISSN (Print)0743-1619

Conference

Conference2019 American Control Conference, ACC 2019
CountryUnited States
CityPhiladelphia
Period7/10/197/12/19

Fingerprint

Sensors
Learning systems
Magnetic sensors
Kalman filters
Learning algorithms
Support vector machines
Cameras
Wearable sensors

Cite this

Johnson, G., Wang, Y., & Rajamani, R. (2019). Real-time detection of food consumption activities using wearable wireless sensors. In 2019 American Control Conference, ACC 2019 (pp. 3450-3455). [8814983] (Proceedings of the American Control Conference; Vol. 2019-July). Institute of Electrical and Electronics Engineers Inc..

Real-time detection of food consumption activities using wearable wireless sensors. / Johnson, Gregory; Wang, Yan; Rajamani, Rajesh.

2019 American Control Conference, ACC 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 3450-3455 8814983 (Proceedings of the American Control Conference; Vol. 2019-July).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Johnson, G, Wang, Y & Rajamani, R 2019, Real-time detection of food consumption activities using wearable wireless sensors. in 2019 American Control Conference, ACC 2019., 8814983, Proceedings of the American Control Conference, vol. 2019-July, Institute of Electrical and Electronics Engineers Inc., pp. 3450-3455, 2019 American Control Conference, ACC 2019, Philadelphia, United States, 7/10/19.
Johnson G, Wang Y, Rajamani R. Real-time detection of food consumption activities using wearable wireless sensors. In 2019 American Control Conference, ACC 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 3450-3455. 8814983. (Proceedings of the American Control Conference).
Johnson, Gregory ; Wang, Yan ; Rajamani, Rajesh. / Real-time detection of food consumption activities using wearable wireless sensors. 2019 American Control Conference, ACC 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 3450-3455 (Proceedings of the American Control Conference).
@inproceedings{1ce9cbb23f334469868439507009cddd,
title = "Real-time detection of food consumption activities using wearable wireless sensors",
abstract = "This paper addresses research challenges associated with development of a wearable sensor system for detecting the food consumption activities of a subject. The objective is to automatically detect the occurrence of food consumption whenever it occurs, in order to use this activity detection to record a representative camera image of the food and count the number of bites of food consumed. The wearable system consists of two elastic bands - one each on the upper arm and wrist - instrumented with wireless inertial and magnetic sensors. Two major technical challenges include i) singularity issues with Euler angle estimation due to arm rotations that can exceed 90 degrees, and ii) the need to differentiate between eating and non-eating activities involving close hand-mouth proximity. The singularity challenge is addressed by using a direction cosine matrix estimation technique that utilizes a linear Kalman Filter. The differentiation between eating and non-eating activities is done using a support-vector-machine (SVM) based machine learning algorithm. Experimental results using wearable prototype bands show that both the DCM estimation and machine learning components work reliably and have the potential to be useful for home-based automated food intake detection.",
author = "Gregory Johnson and Yan Wang and Rajesh Rajamani",
year = "2019",
month = "7",
language = "English (US)",
series = "Proceedings of the American Control Conference",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "3450--3455",
booktitle = "2019 American Control Conference, ACC 2019",

}

TY - GEN

T1 - Real-time detection of food consumption activities using wearable wireless sensors

AU - Johnson, Gregory

AU - Wang, Yan

AU - Rajamani, Rajesh

PY - 2019/7

Y1 - 2019/7

N2 - This paper addresses research challenges associated with development of a wearable sensor system for detecting the food consumption activities of a subject. The objective is to automatically detect the occurrence of food consumption whenever it occurs, in order to use this activity detection to record a representative camera image of the food and count the number of bites of food consumed. The wearable system consists of two elastic bands - one each on the upper arm and wrist - instrumented with wireless inertial and magnetic sensors. Two major technical challenges include i) singularity issues with Euler angle estimation due to arm rotations that can exceed 90 degrees, and ii) the need to differentiate between eating and non-eating activities involving close hand-mouth proximity. The singularity challenge is addressed by using a direction cosine matrix estimation technique that utilizes a linear Kalman Filter. The differentiation between eating and non-eating activities is done using a support-vector-machine (SVM) based machine learning algorithm. Experimental results using wearable prototype bands show that both the DCM estimation and machine learning components work reliably and have the potential to be useful for home-based automated food intake detection.

AB - This paper addresses research challenges associated with development of a wearable sensor system for detecting the food consumption activities of a subject. The objective is to automatically detect the occurrence of food consumption whenever it occurs, in order to use this activity detection to record a representative camera image of the food and count the number of bites of food consumed. The wearable system consists of two elastic bands - one each on the upper arm and wrist - instrumented with wireless inertial and magnetic sensors. Two major technical challenges include i) singularity issues with Euler angle estimation due to arm rotations that can exceed 90 degrees, and ii) the need to differentiate between eating and non-eating activities involving close hand-mouth proximity. The singularity challenge is addressed by using a direction cosine matrix estimation technique that utilizes a linear Kalman Filter. The differentiation between eating and non-eating activities is done using a support-vector-machine (SVM) based machine learning algorithm. Experimental results using wearable prototype bands show that both the DCM estimation and machine learning components work reliably and have the potential to be useful for home-based automated food intake detection.

UR - http://www.scopus.com/inward/record.url?scp=85072269352&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85072269352&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85072269352

T3 - Proceedings of the American Control Conference

SP - 3450

EP - 3455

BT - 2019 American Control Conference, ACC 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -