Classification of Human Gaze in Spatial Guidance and Control

Bin Li, Berenice F Mettler May, Jonathan Andersh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

Visual gaze movement is one of the main processes in human interaction with the physical environment, and is a manifestation of the visual perception process. In humans, the interaction of gaze with environment involves mainly three patterns including fixation, smooth pursuit and saccade. This paper investigates two classification techniques to identify gaze patterns: An empirical threshold method and a Hidden Markov Model (HMM). A registration process was initially performed to transform the gaze and environmental visual cues into a common coordinate system, which provides an additional feature to construct gaze models. With the gaze models, the HMM method accurately identifies gaze patterns in gaze trajectories, and in addition enables three types of applications. One is the detailed analysis of visuo-motor control behavior. The second is gaze-mediated teleoperation, showing the real-Time capability of the gaze classification method. The third is the application to surgery tasks, enabling surgical skill analysis.

Original languageEnglish (US)
Title of host publicationProceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1073-1080
Number of pages8
ISBN (Electronic)9781479986965
DOIs
StatePublished - Jan 12 2016
EventIEEE International Conference on Systems, Man, and Cybernetics, SMC 2015 - Kowloon Tong, Hong Kong
Duration: Oct 9 2015Oct 12 2015

Publication series

NameProceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015

Other

OtherIEEE International Conference on Systems, Man, and Cybernetics, SMC 2015
CountryHong Kong
CityKowloon Tong
Period10/9/1510/12/15

Fingerprint

Hidden Markov models
Eye movements
Remote control
Surgery
Trajectories
Guidance
Hidden Markov model
Interaction

Keywords

  • Gaze
  • classification
  • fixation
  • registration
  • saccade
  • smooth pursuit

Cite this

Li, B., Mettler May, B. F., & Andersh, J. (2016). Classification of Human Gaze in Spatial Guidance and Control. In Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015 (pp. 1073-1080). [7379325] (Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SMC.2015.193

Classification of Human Gaze in Spatial Guidance and Control. / Li, Bin; Mettler May, Berenice F; Andersh, Jonathan.

Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015. Institute of Electrical and Electronics Engineers Inc., 2016. p. 1073-1080 7379325 (Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Li, B, Mettler May, BF & Andersh, J 2016, Classification of Human Gaze in Spatial Guidance and Control. in Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015., 7379325, Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015, Institute of Electrical and Electronics Engineers Inc., pp. 1073-1080, IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015, Kowloon Tong, Hong Kong, 10/9/15. https://doi.org/10.1109/SMC.2015.193
Li B, Mettler May BF, Andersh J. Classification of Human Gaze in Spatial Guidance and Control. In Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015. Institute of Electrical and Electronics Engineers Inc. 2016. p. 1073-1080. 7379325. (Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015). https://doi.org/10.1109/SMC.2015.193
Li, Bin ; Mettler May, Berenice F ; Andersh, Jonathan. / Classification of Human Gaze in Spatial Guidance and Control. Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 1073-1080 (Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015).
@inproceedings{28f37c7f347b4a099deaea10a2ef7e73,
title = "Classification of Human Gaze in Spatial Guidance and Control",
abstract = "Visual gaze movement is one of the main processes in human interaction with the physical environment, and is a manifestation of the visual perception process. In humans, the interaction of gaze with environment involves mainly three patterns including fixation, smooth pursuit and saccade. This paper investigates two classification techniques to identify gaze patterns: An empirical threshold method and a Hidden Markov Model (HMM). A registration process was initially performed to transform the gaze and environmental visual cues into a common coordinate system, which provides an additional feature to construct gaze models. With the gaze models, the HMM method accurately identifies gaze patterns in gaze trajectories, and in addition enables three types of applications. One is the detailed analysis of visuo-motor control behavior. The second is gaze-mediated teleoperation, showing the real-Time capability of the gaze classification method. The third is the application to surgery tasks, enabling surgical skill analysis.",
keywords = "Gaze, classification, fixation, registration, saccade, smooth pursuit",
author = "Bin Li and {Mettler May}, {Berenice F} and Jonathan Andersh",
year = "2016",
month = "1",
day = "12",
doi = "10.1109/SMC.2015.193",
language = "English (US)",
series = "Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1073--1080",
booktitle = "Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015",

}

TY - GEN

T1 - Classification of Human Gaze in Spatial Guidance and Control

AU - Li, Bin

AU - Mettler May, Berenice F

AU - Andersh, Jonathan

PY - 2016/1/12

Y1 - 2016/1/12

N2 - Visual gaze movement is one of the main processes in human interaction with the physical environment, and is a manifestation of the visual perception process. In humans, the interaction of gaze with environment involves mainly three patterns including fixation, smooth pursuit and saccade. This paper investigates two classification techniques to identify gaze patterns: An empirical threshold method and a Hidden Markov Model (HMM). A registration process was initially performed to transform the gaze and environmental visual cues into a common coordinate system, which provides an additional feature to construct gaze models. With the gaze models, the HMM method accurately identifies gaze patterns in gaze trajectories, and in addition enables three types of applications. One is the detailed analysis of visuo-motor control behavior. The second is gaze-mediated teleoperation, showing the real-Time capability of the gaze classification method. The third is the application to surgery tasks, enabling surgical skill analysis.

AB - Visual gaze movement is one of the main processes in human interaction with the physical environment, and is a manifestation of the visual perception process. In humans, the interaction of gaze with environment involves mainly three patterns including fixation, smooth pursuit and saccade. This paper investigates two classification techniques to identify gaze patterns: An empirical threshold method and a Hidden Markov Model (HMM). A registration process was initially performed to transform the gaze and environmental visual cues into a common coordinate system, which provides an additional feature to construct gaze models. With the gaze models, the HMM method accurately identifies gaze patterns in gaze trajectories, and in addition enables three types of applications. One is the detailed analysis of visuo-motor control behavior. The second is gaze-mediated teleoperation, showing the real-Time capability of the gaze classification method. The third is the application to surgery tasks, enabling surgical skill analysis.

KW - Gaze

KW - classification

KW - fixation

KW - registration

KW - saccade

KW - smooth pursuit

UR - http://www.scopus.com/inward/record.url?scp=84964561169&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964561169&partnerID=8YFLogxK

U2 - 10.1109/SMC.2015.193

DO - 10.1109/SMC.2015.193

M3 - Conference contribution

AN - SCOPUS:84964561169

T3 - Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015

SP - 1073

EP - 1080

BT - Proceedings - 2015 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -