Immersive analytics for medicine: Hybrid 2D/3D sketch-based interfaces for annotating medical data and designing medical devices

Seth Johnson, Arthur G Erdman, Bret Jackson, Daniel F Keefe, Bethany Tourek, Marcos G Molina

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

We explore the role that immersive technologies, specifically virtual reality (VR) and hybrid 2D/3D sketch-based interfaces and visualizations, can play in analytical reasoning for medicine. Two case studies are described: (1) immersive explanations of medical procedures, and (2) immersive design of medical devices. Both tightly integrate 2D imagery and data with 3D interfaces, models, and visualizations. This is an approach we argue is likely to be particularly useful in medicine, where analytical tasks often involve relating 2D data (e.g., medical imaging) to 3D contexts (e.g., a patient's body). User feedback and observations from our interdisciplinary team indicate the utility of the approach for the current case studies as well as some shortcomings and areas for future research. This work contributes to a broader discussion of how hybrid 2D/3D interfaces may form an essential ingredient of future immersive analytics systems across a variety of domains.

Original languageEnglish (US)
Title of host publicationCompanion Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces
Subtitle of host publicationNature Meets Interactive Surfaces, ISS 2016
PublisherAssociation for Computing Machinery, Inc
Pages107-113
Number of pages7
ISBN (Electronic)9781450345309
DOIs
StatePublished - Nov 6 2016
Event11th Annual ACM International Conference on Interactive Surfaces and Spaces, ISS Companion 2016 - Niagara Falls, Canada
Duration: Nov 6 2016Nov 9 2016

Publication series

NameCompanion Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces: Nature Meets Interactive Surfaces, ISS 2016

Other

Other11th Annual ACM International Conference on Interactive Surfaces and Spaces, ISS Companion 2016
CountryCanada
CityNiagara Falls
Period11/6/1611/9/16

Keywords

  • Hybrid 2D/3D User Interfaces
  • Immersive 3D Modeling
  • Immersive Analytics
  • Visualization

Fingerprint Dive into the research topics of 'Immersive analytics for medicine: Hybrid 2D/3D sketch-based interfaces for annotating medical data and designing medical devices'. Together they form a unique fingerprint.

  • Cite this

    Johnson, S., Erdman, A. G., Jackson, B., Keefe, D. F., Tourek, B., & Molina, M. G. (2016). Immersive analytics for medicine: Hybrid 2D/3D sketch-based interfaces for annotating medical data and designing medical devices. In Companion Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces: Nature Meets Interactive Surfaces, ISS 2016 (pp. 107-113). (Companion Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces: Nature Meets Interactive Surfaces, ISS 2016). Association for Computing Machinery, Inc. https://doi.org/10.1145/3009939.3009956