Multimodal Interactions In Multi-Display Semi-Immersive Environments

Adam Fouse, Chad Weiss, Ryan Mullins, Chris Hanna, Ben Nargi, Daniel F Keefe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Spatial navigation of virtual environments often requires different categories of navigation actions. In this paper, we describe a mapping between different forms of navigation and multimodal interactions to accomplish the actions. We select and define three forms of navigation, identify characteristics of those forms, and describe interactions that were selected to match those characteristics. We developed these mappings within a multidisplay, semi-immersive environment assembled from commodity components, with a goal of supporting use of similar semiimmersive environments in operational settings. In designing the interaction mappings, we considered both the constraints imposed by the environment as well as likely tasks of the targeted user populations. The goal of creating the mappings is to enable fast, natural, and efficient interactions, and minimize attention shifting.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018
EditorsOdd Erik Gundersen, Christian Lebiere, Galina L. Rogova, Ken Baclawski, Andrea Salfinger
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages36-41
Number of pages6
ISBN (Print)9781538652886
DOIs
StatePublished - Jul 31 2018
Event8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018 - Boston, United States
Duration: Jun 11 2018Jun 14 2018

Publication series

NameProceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018

Other

Other8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018
CountryUnited States
CityBoston
Period6/11/186/14/18

Fingerprint

Navigation
Display devices
Virtual reality
Population
Interaction
Spatial Navigation

Keywords

  • command and control
  • multimodal interaction
  • semi-immersive environments
  • spatial navigation

Cite this

Fouse, A., Weiss, C., Mullins, R., Hanna, C., Nargi, B., & Keefe, D. F. (2018). Multimodal Interactions In Multi-Display Semi-Immersive Environments. In O. E. Gundersen, C. Lebiere, G. L. Rogova, K. Baclawski, & A. Salfinger (Eds.), Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018 (pp. 36-41). [8423999] (Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/COGSIMA.2018.8423999

Multimodal Interactions In Multi-Display Semi-Immersive Environments. / Fouse, Adam; Weiss, Chad; Mullins, Ryan; Hanna, Chris; Nargi, Ben; Keefe, Daniel F.

Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018. ed. / Odd Erik Gundersen; Christian Lebiere; Galina L. Rogova; Ken Baclawski; Andrea Salfinger. Institute of Electrical and Electronics Engineers Inc., 2018. p. 36-41 8423999 (Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fouse, A, Weiss, C, Mullins, R, Hanna, C, Nargi, B & Keefe, DF 2018, Multimodal Interactions In Multi-Display Semi-Immersive Environments. in OE Gundersen, C Lebiere, GL Rogova, K Baclawski & A Salfinger (eds), Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018., 8423999, Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018, Institute of Electrical and Electronics Engineers Inc., pp. 36-41, 8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018, Boston, United States, 6/11/18. https://doi.org/10.1109/COGSIMA.2018.8423999
Fouse A, Weiss C, Mullins R, Hanna C, Nargi B, Keefe DF. Multimodal Interactions In Multi-Display Semi-Immersive Environments. In Gundersen OE, Lebiere C, Rogova GL, Baclawski K, Salfinger A, editors, Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 36-41. 8423999. (Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018). https://doi.org/10.1109/COGSIMA.2018.8423999
Fouse, Adam ; Weiss, Chad ; Mullins, Ryan ; Hanna, Chris ; Nargi, Ben ; Keefe, Daniel F. / Multimodal Interactions In Multi-Display Semi-Immersive Environments. Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018. editor / Odd Erik Gundersen ; Christian Lebiere ; Galina L. Rogova ; Ken Baclawski ; Andrea Salfinger. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 36-41 (Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018).
@inproceedings{f281f3cb75fc423e8afa651764c45012,
title = "Multimodal Interactions In Multi-Display Semi-Immersive Environments",
abstract = "Spatial navigation of virtual environments often requires different categories of navigation actions. In this paper, we describe a mapping between different forms of navigation and multimodal interactions to accomplish the actions. We select and define three forms of navigation, identify characteristics of those forms, and describe interactions that were selected to match those characteristics. We developed these mappings within a multidisplay, semi-immersive environment assembled from commodity components, with a goal of supporting use of similar semiimmersive environments in operational settings. In designing the interaction mappings, we considered both the constraints imposed by the environment as well as likely tasks of the targeted user populations. The goal of creating the mappings is to enable fast, natural, and efficient interactions, and minimize attention shifting.",
keywords = "command and control, multimodal interaction, semi-immersive environments, spatial navigation",
author = "Adam Fouse and Chad Weiss and Ryan Mullins and Chris Hanna and Ben Nargi and Keefe, {Daniel F}",
year = "2018",
month = "7",
day = "31",
doi = "10.1109/COGSIMA.2018.8423999",
language = "English (US)",
isbn = "9781538652886",
series = "Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "36--41",
editor = "Gundersen, {Odd Erik} and Christian Lebiere and Rogova, {Galina L.} and Ken Baclawski and Andrea Salfinger",
booktitle = "Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018",

}

TY - GEN

T1 - Multimodal Interactions In Multi-Display Semi-Immersive Environments

AU - Fouse, Adam

AU - Weiss, Chad

AU - Mullins, Ryan

AU - Hanna, Chris

AU - Nargi, Ben

AU - Keefe, Daniel F

PY - 2018/7/31

Y1 - 2018/7/31

N2 - Spatial navigation of virtual environments often requires different categories of navigation actions. In this paper, we describe a mapping between different forms of navigation and multimodal interactions to accomplish the actions. We select and define three forms of navigation, identify characteristics of those forms, and describe interactions that were selected to match those characteristics. We developed these mappings within a multidisplay, semi-immersive environment assembled from commodity components, with a goal of supporting use of similar semiimmersive environments in operational settings. In designing the interaction mappings, we considered both the constraints imposed by the environment as well as likely tasks of the targeted user populations. The goal of creating the mappings is to enable fast, natural, and efficient interactions, and minimize attention shifting.

AB - Spatial navigation of virtual environments often requires different categories of navigation actions. In this paper, we describe a mapping between different forms of navigation and multimodal interactions to accomplish the actions. We select and define three forms of navigation, identify characteristics of those forms, and describe interactions that were selected to match those characteristics. We developed these mappings within a multidisplay, semi-immersive environment assembled from commodity components, with a goal of supporting use of similar semiimmersive environments in operational settings. In designing the interaction mappings, we considered both the constraints imposed by the environment as well as likely tasks of the targeted user populations. The goal of creating the mappings is to enable fast, natural, and efficient interactions, and minimize attention shifting.

KW - command and control

KW - multimodal interaction

KW - semi-immersive environments

KW - spatial navigation

UR - http://www.scopus.com/inward/record.url?scp=85051480515&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051480515&partnerID=8YFLogxK

U2 - 10.1109/COGSIMA.2018.8423999

DO - 10.1109/COGSIMA.2018.8423999

M3 - Conference contribution

SN - 9781538652886

T3 - Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018

SP - 36

EP - 41

BT - Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018

A2 - Gundersen, Odd Erik

A2 - Lebiere, Christian

A2 - Rogova, Galina L.

A2 - Baclawski, Ken

A2 - Salfinger, Andrea

PB - Institute of Electrical and Electronics Engineers Inc.

ER -