Multimodal Interactions In Multi-Display Semi-Immersive Environments

Adam Fouse, Chad Weiss, Ryan Mullins, Chris Hanna, Ben Nargi, Daniel F. Keefe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Spatial navigation of virtual environments often requires different categories of navigation actions. In this paper, we describe a mapping between different forms of navigation and multimodal interactions to accomplish the actions. We select and define three forms of navigation, identify characteristics of those forms, and describe interactions that were selected to match those characteristics. We developed these mappings within a multidisplay, semi-immersive environment assembled from commodity components, with a goal of supporting use of similar semiimmersive environments in operational settings. In designing the interaction mappings, we considered both the constraints imposed by the environment as well as likely tasks of the targeted user populations. The goal of creating the mappings is to enable fast, natural, and efficient interactions, and minimize attention shifting.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018
EditorsOdd Erik Gundersen, Christian Lebiere, Galina L. Rogova, Ken Baclawski, Andrea Salfinger
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages36-41
Number of pages6
ISBN (Print)9781538652886
DOIs
StatePublished - Jul 31 2018
Event8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018 - Boston, United States
Duration: Jun 11 2018Jun 14 2018

Publication series

NameProceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018

Other

Other8th IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018
CountryUnited States
CityBoston
Period6/11/186/14/18

Keywords

  • command and control
  • multimodal interaction
  • semi-immersive environments
  • spatial navigation

Fingerprint Dive into the research topics of 'Multimodal Interactions In Multi-Display Semi-Immersive Environments'. Together they form a unique fingerprint.

  • Cite this

    Fouse, A., Weiss, C., Mullins, R., Hanna, C., Nargi, B., & Keefe, D. F. (2018). Multimodal Interactions In Multi-Display Semi-Immersive Environments. In O. E. Gundersen, C. Lebiere, G. L. Rogova, K. Baclawski, & A. Salfinger (Eds.), Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018 (pp. 36-41). [8423999] (Proceedings - 2018 IEEE International Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/COGSIMA.2018.8423999