Out of the Fr-"Eye"-ing Pan: Towards gaze-based models of attention during learning with technology in the classroom

Stephen Hutt; Caitlin Mills; Nigel Bosch; Kristina Krasich; James Brockmole; Sidney D'mello

doi:10.1145/3079628.3079669

Out of the Fr-"Eye"-ing Pan: Towards gaze-based models of attention during learning with technology in the classroom

Stephen Hutt
, Caitlin Mills
, Nigel Bosch
, Kristina Krasich
, James Brockmole
, Sidney D'mello

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

61 Scopus citations

Abstract

Attention is critical to learning. Hence, advanced learning technologies should benefit from mechanisms to monitor and respond to learners' attentional states. We study the feasibility of integrating commercial off-The-shelf (COTS) eye trackers to monitor attention during interactions with a learning technology called GuruTutor. We tested our implementation on 135 students in a noisy computer-enabled high school classroom and were able to collect a median 95% valid eye gaze data in 85% of the sessions where gaze data was successfully recorded. Machine learning methods were employed to develop automated detectors of mind wandering (MW) -A phenomenon involving a shift in attention from task-related to task-unrelated thoughts that is negatively correlated with performance. Our student-independent, gaze-based models could detect MW with an accuracy (F1 of MW = 0.59) significantly greater than chance (F1 of MW = 0.24). Predicted rates of mind wandering were negatively related to posttest performance, providing evidence for the predictive validity of the detector. We discuss next steps towards developing gaze-based, attention-Aware, learning technologies that can be deployed in noisy, real-world environments.

Original language	English (US)
Title of host publication	UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization
Publisher	Association for Computing Machinery, Inc
Pages	94-103
Number of pages	10
ISBN (Electronic)	9781450346351
DOIs	https://doi.org/10.1145/3079628.3079669
State	Published - Jul 9 2017
Externally published	Yes
Event	25th ACM International Conference on User Modeling, Adaptation, and Personalization, UMAP 2017 - Bratislava, Slovakia Duration: Jul 9 2017 → Jul 12 2017

Publication series

Name	UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization

Conference

Conference	25th ACM International Conference on User Modeling, Adaptation, and Personalization, UMAP 2017
Country/Territory	Slovakia
City	Bratislava
Period	7/9/17 → 7/12/17

Bibliographical note

Publisher Copyright:
©2017 ACM.

Keywords

Attention-Aware learning
Cyberlearning
Eye-gaze
Intelligent tutoring systems
Mind wandering

Publisher link

10.1145/3079628.3079669

Find It

Find It at U of M Libraries

Cite this

Hutt, S., Mills, C., Bosch, N., Krasich, K., Brockmole, J., & D'mello, S. (2017). Out of the Fr-"Eye"-ing Pan: Towards gaze-based models of attention during learning with technology in the classroom. In UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization (pp. 94-103). (UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization). Association for Computing Machinery, Inc. https://doi.org/10.1145/3079628.3079669

Out of the Fr-"Eye"-ing Pan: Towards gaze-based models of attention during learning with technology in the classroom. / Hutt, Stephen ; Mills, Caitlin; Bosch, Nigel et al.
UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. Association for Computing Machinery, Inc, 2017. p. 94-103 (UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Hutt, S , Mills, C, Bosch, N, Krasich, K, Brockmole, J & D'mello, S 2017, Out of the Fr-"Eye"-ing Pan: Towards gaze-based models of attention during learning with technology in the classroom. in UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, Association for Computing Machinery, Inc, pp. 94-103, 25th ACM International Conference on User Modeling, Adaptation, and Personalization, UMAP 2017, Bratislava, Slovakia, 7/9/17. https://doi.org/10.1145/3079628.3079669

Hutt S , Mills C, Bosch N, Krasich K, Brockmole J, D'mello S. Out of the Fr-"Eye"-ing Pan: Towards gaze-based models of attention during learning with technology in the classroom. In UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. Association for Computing Machinery, Inc. 2017. p. 94-103. (UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization). doi: 10.1145/3079628.3079669

Hutt, Stephen ; Mills, Caitlin ; Bosch, Nigel et al. / Out of the Fr-"Eye"-ing Pan : Towards gaze-based models of attention during learning with technology in the classroom. UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. Association for Computing Machinery, Inc, 2017. pp. 94-103 (UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization).

@inproceedings{6f57e2770055450e8b392933ccbe42be,

title = "Out of the Fr-{"}Eye{"}-ing Pan: Towards gaze-based models of attention during learning with technology in the classroom",

abstract = "Attention is critical to learning. Hence, advanced learning technologies should benefit from mechanisms to monitor and respond to learners' attentional states. We study the feasibility of integrating commercial off-The-shelf (COTS) eye trackers to monitor attention during interactions with a learning technology called GuruTutor. We tested our implementation on 135 students in a noisy computer-enabled high school classroom and were able to collect a median 95\% valid eye gaze data in 85\% of the sessions where gaze data was successfully recorded. Machine learning methods were employed to develop automated detectors of mind wandering (MW) -A phenomenon involving a shift in attention from task-related to task-unrelated thoughts that is negatively correlated with performance. Our student-independent, gaze-based models could detect MW with an accuracy (F1 of MW = 0.59) significantly greater than chance (F1 of MW = 0.24). Predicted rates of mind wandering were negatively related to posttest performance, providing evidence for the predictive validity of the detector. We discuss next steps towards developing gaze-based, attention-Aware, learning technologies that can be deployed in noisy, real-world environments.",

keywords = "Attention-Aware learning, Cyberlearning, Eye-gaze, Intelligent tutoring systems, Mind wandering",

author = "Stephen Hutt and Caitlin Mills and Nigel Bosch and Kristina Krasich and James Brockmole and Sidney D'mello",

note = "Publisher Copyright: {\textcopyright}2017 ACM.; 25th ACM International Conference on User Modeling, Adaptation, and Personalization, UMAP 2017 ; Conference date: 09-07-2017 Through 12-07-2017",

year = "2017",

month = jul,

day = "9",

doi = "10.1145/3079628.3079669",

language = "English (US)",

series = "UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization",

publisher = "Association for Computing Machinery, Inc",

pages = "94--103",

booktitle = "UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization",

}

TY - GEN

T1 - Out of the Fr-"Eye"-ing Pan

T2 - 25th ACM International Conference on User Modeling, Adaptation, and Personalization, UMAP 2017

AU - Hutt, Stephen

AU - Mills, Caitlin

AU - Bosch, Nigel

AU - Krasich, Kristina

AU - Brockmole, James

AU - D'mello, Sidney

PY - 2017/7/9

Y1 - 2017/7/9

N2 - Attention is critical to learning. Hence, advanced learning technologies should benefit from mechanisms to monitor and respond to learners' attentional states. We study the feasibility of integrating commercial off-The-shelf (COTS) eye trackers to monitor attention during interactions with a learning technology called GuruTutor. We tested our implementation on 135 students in a noisy computer-enabled high school classroom and were able to collect a median 95% valid eye gaze data in 85% of the sessions where gaze data was successfully recorded. Machine learning methods were employed to develop automated detectors of mind wandering (MW) -A phenomenon involving a shift in attention from task-related to task-unrelated thoughts that is negatively correlated with performance. Our student-independent, gaze-based models could detect MW with an accuracy (F1 of MW = 0.59) significantly greater than chance (F1 of MW = 0.24). Predicted rates of mind wandering were negatively related to posttest performance, providing evidence for the predictive validity of the detector. We discuss next steps towards developing gaze-based, attention-Aware, learning technologies that can be deployed in noisy, real-world environments.

AB - Attention is critical to learning. Hence, advanced learning technologies should benefit from mechanisms to monitor and respond to learners' attentional states. We study the feasibility of integrating commercial off-The-shelf (COTS) eye trackers to monitor attention during interactions with a learning technology called GuruTutor. We tested our implementation on 135 students in a noisy computer-enabled high school classroom and were able to collect a median 95% valid eye gaze data in 85% of the sessions where gaze data was successfully recorded. Machine learning methods were employed to develop automated detectors of mind wandering (MW) -A phenomenon involving a shift in attention from task-related to task-unrelated thoughts that is negatively correlated with performance. Our student-independent, gaze-based models could detect MW with an accuracy (F1 of MW = 0.59) significantly greater than chance (F1 of MW = 0.24). Predicted rates of mind wandering were negatively related to posttest performance, providing evidence for the predictive validity of the detector. We discuss next steps towards developing gaze-based, attention-Aware, learning technologies that can be deployed in noisy, real-world environments.

KW - Attention-Aware learning

KW - Cyberlearning

KW - Eye-gaze

KW - Intelligent tutoring systems

KW - Mind wandering

UR - https://www.scopus.com/pages/publications/85026756708

UR - https://www.scopus.com/pages/publications/85026756708#tab=citedBy

U2 - 10.1145/3079628.3079669

DO - 10.1145/3079628.3079669

M3 - Conference contribution

AN - SCOPUS:85026756708

T3 - UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization

SP - 94

EP - 103

BT - UMAP 2017 - Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization

PB - Association for Computing Machinery, Inc

Y2 - 9 July 2017 through 12 July 2017

ER -

Out of the Fr-"Eye"-ing Pan: Towards gaze-based models of attention during learning with technology in the classroom

Abstract

Publication series

Conference

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this