Multimodal Interactions In Multi-Display Semi-Immersive Environments

Adam Fouse; Chad Weiss; Ryan Mullins; Chris Hanna; Ben Nargi; Daniel F. Keefe

doi:10.1109/COGSIMA.2018.8423999

Multimodal Interactions In Multi-Display Semi-Immersive Environments

Adam Fouse, Chad Weiss, Ryan Mullins, Chris Hanna, Ben Nargi, Daniel F. Keefe

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Scopus citations

Abstract

Spatial navigation of virtual environments often requires different categories of navigation actions. In this paper, we describe a mapping between different forms of navigation and multimodal interactions to accomplish the actions. We select and define three forms of navigation, identify characteristics of those forms, and describe interactions that were selected to match those characteristics. We developed these mappings within a multidisplay, semi-immersive environment assembled from commodity components, with a goal of supporting use of similar semiimmersive environments in operational settings. In designing the interaction mappings, we considered both the constraints imposed by the environment as well as likely tasks of the targeted user populations. The goal of creating the mappings is to enable fast, natural, and efficient interactions, and minimize attention shifting.

Original language	English (US)
Title of host publication	Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018
Editors	Odd Erik Gundersen, Christian Lebiere, Galina L. Rogova, Ken Baclawski, Andrea Salfinger
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	36-41
Number of pages	6
ISBN (Print)	9781538652886
DOIs	https://doi.org/10.1109/COGSIMA.2018.8423999
State	Published - Jul 31 2018
Event	8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018 - Boston, United States Duration: Jun 11 2018 → Jun 14 2018

Publication series

Name	Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018

Other

Other	8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018
Country/Territory	United States
City	Boston
Period	6/11/18 → 6/14/18

Bibliographical note

Funding Information:
This research was performed in connection with contract FA8650-14-C-6537 with the Air Force Research Laboratory (AFRL). The authors would like to thank Spencer Lynch and Stacy Pfautz of Aptima, and Brian Donnelly and Terry Stanard of the AFRL, for their contributions and guidance of this work.

Publisher Copyright:
© 2018 IEEE.

Keywords

command and control
multimodal interaction
semi-immersive environments
spatial navigation

Publisher link

10.1109/COGSIMA.2018.8423999

Find It

Find It at U of M Libraries

Cite this

Fouse, A., Weiss, C., Mullins, R., Hanna, C., Nargi, B., & Keefe, D. F. (2018). Multimodal Interactions In Multi-Display Semi-Immersive Environments. In O. E. Gundersen, C. Lebiere, G. L. Rogova, K. Baclawski, & A. Salfinger (Eds.), Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018 (pp. 36-41). Article 8423999 (Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/COGSIMA.2018.8423999

Multimodal Interactions In Multi-Display Semi-Immersive Environments. / Fouse, Adam; Weiss, Chad; Mullins, Ryan et al.
Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018. ed. / Odd Erik Gundersen; Christian Lebiere; Galina L. Rogova; Ken Baclawski; Andrea Salfinger. Institute of Electrical and Electronics Engineers Inc., 2018. p. 36-41 8423999 (Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Fouse, A, Weiss, C, Mullins, R, Hanna, C, Nargi, B & Keefe, DF 2018, Multimodal Interactions In Multi-Display Semi-Immersive Environments. in OE Gundersen, C Lebiere, GL Rogova, K Baclawski & A Salfinger (eds), Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018., 8423999, Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018, Institute of Electrical and Electronics Engineers Inc., pp. 36-41, 8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018, Boston, United States, 6/11/18. https://doi.org/10.1109/COGSIMA.2018.8423999

Fouse A, Weiss C, Mullins R, Hanna C, Nargi B, Keefe DF. Multimodal Interactions In Multi-Display Semi-Immersive Environments. In Gundersen OE, Lebiere C, Rogova GL, Baclawski K, Salfinger A, editors, Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 36-41. 8423999. (Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018). doi: 10.1109/COGSIMA.2018.8423999

Fouse, Adam ; Weiss, Chad ; Mullins, Ryan et al. / Multimodal Interactions In Multi-Display Semi-Immersive Environments. Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018. editor / Odd Erik Gundersen ; Christian Lebiere ; Galina L. Rogova ; Ken Baclawski ; Andrea Salfinger. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 36-41 (Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018).

@inproceedings{f281f3cb75fc423e8afa651764c45012,

title = "Multimodal Interactions In Multi-Display Semi-Immersive Environments",

abstract = "Spatial navigation of virtual environments often requires different categories of navigation actions. In this paper, we describe a mapping between different forms of navigation and multimodal interactions to accomplish the actions. We select and define three forms of navigation, identify characteristics of those forms, and describe interactions that were selected to match those characteristics. We developed these mappings within a multidisplay, semi-immersive environment assembled from commodity components, with a goal of supporting use of similar semiimmersive environments in operational settings. In designing the interaction mappings, we considered both the constraints imposed by the environment as well as likely tasks of the targeted user populations. The goal of creating the mappings is to enable fast, natural, and efficient interactions, and minimize attention shifting.",

keywords = "command and control, multimodal interaction, semi-immersive environments, spatial navigation",

author = "Adam Fouse and Chad Weiss and Ryan Mullins and Chris Hanna and Ben Nargi and Keefe, {Daniel F.}",

note = "Funding Information: This research was performed in connection with contract FA8650-14-C-6537 with the Air Force Research Laboratory (AFRL). The authors would like to thank Spencer Lynch and Stacy Pfautz of Aptima, and Brian Donnelly and Terry Stanard of the AFRL, for their contributions and guidance of this work. Publisher Copyright: {\textcopyright} 2018 IEEE.; 8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018 ; Conference date: 11-06-2018 Through 14-06-2018",

year = "2018",

month = jul,

day = "31",

doi = "10.1109/COGSIMA.2018.8423999",

language = "English (US)",

isbn = "9781538652886",

series = "Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "36--41",

editor = "Gundersen, {Odd Erik} and Christian Lebiere and Rogova, {Galina L.} and Ken Baclawski and Andrea Salfinger",

booktitle = "Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018",

}

TY - GEN

T1 - Multimodal Interactions In Multi-Display Semi-Immersive Environments

AU - Fouse, Adam

AU - Weiss, Chad

AU - Mullins, Ryan

AU - Hanna, Chris

AU - Nargi, Ben

AU - Keefe, Daniel F.

N1 - Funding Information: This research was performed in connection with contract FA8650-14-C-6537 with the Air Force Research Laboratory (AFRL). The authors would like to thank Spencer Lynch and Stacy Pfautz of Aptima, and Brian Donnelly and Terry Stanard of the AFRL, for their contributions and guidance of this work. Publisher Copyright: © 2018 IEEE.

PY - 2018/7/31

Y1 - 2018/7/31

N2 - Spatial navigation of virtual environments often requires different categories of navigation actions. In this paper, we describe a mapping between different forms of navigation and multimodal interactions to accomplish the actions. We select and define three forms of navigation, identify characteristics of those forms, and describe interactions that were selected to match those characteristics. We developed these mappings within a multidisplay, semi-immersive environment assembled from commodity components, with a goal of supporting use of similar semiimmersive environments in operational settings. In designing the interaction mappings, we considered both the constraints imposed by the environment as well as likely tasks of the targeted user populations. The goal of creating the mappings is to enable fast, natural, and efficient interactions, and minimize attention shifting.

AB - Spatial navigation of virtual environments often requires different categories of navigation actions. In this paper, we describe a mapping between different forms of navigation and multimodal interactions to accomplish the actions. We select and define three forms of navigation, identify characteristics of those forms, and describe interactions that were selected to match those characteristics. We developed these mappings within a multidisplay, semi-immersive environment assembled from commodity components, with a goal of supporting use of similar semiimmersive environments in operational settings. In designing the interaction mappings, we considered both the constraints imposed by the environment as well as likely tasks of the targeted user populations. The goal of creating the mappings is to enable fast, natural, and efficient interactions, and minimize attention shifting.

KW - command and control

KW - multimodal interaction

KW - semi-immersive environments

KW - spatial navigation

UR - http://www.scopus.com/inward/record.url?scp=85051480515&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051480515&partnerID=8YFLogxK

U2 - 10.1109/COGSIMA.2018.8423999

DO - 10.1109/COGSIMA.2018.8423999

M3 - Conference contribution

AN - SCOPUS:85051480515

SN - 9781538652886

T3 - Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018

SP - 36

EP - 41

BT - Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018

A2 - Gundersen, Odd Erik

A2 - Lebiere, Christian

A2 - Rogova, Galina L.

A2 - Baclawski, Ken

A2 - Salfinger, Andrea

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018

Y2 - 11 June 2018 through 14 June 2018

ER -

Multimodal Interactions In Multi-Display Semi-Immersive Environments

Abstract

Publication series

Other

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this