We explore the role that immersive technologies, specifically virtual reality (VR) and hybrid 2D/3D sketch-based interfaces and visualizations, can play in analytical reasoning for medicine. Two case studies are described: (1) immersive explanations of medical procedures, and (2) immersive design of medical devices. Both tightly integrate 2D imagery and data with 3D interfaces, models, and visualizations. This is an approach we argue is likely to be particularly useful in medicine, where analytical tasks often involve relating 2D data (e.g., medical imaging) to 3D contexts (e.g., a patient's body). User feedback and observations from our interdisciplinary team indicate the utility of the approach for the current case studies as well as some shortcomings and areas for future research. This work contributes to a broader discussion of how hybrid 2D/3D interfaces may form an essential ingredient of future immersive analytics systems across a variety of domains.
|Original language||English (US)|
|Title of host publication||Companion Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces|
|Subtitle of host publication||Nature Meets Interactive Surfaces, ISS 2016|
|Publisher||Association for Computing Machinery, Inc|
|Number of pages||7|
|State||Published - Nov 6 2016|
|Event||11th Annual ACM International Conference on Interactive Surfaces and Spaces, ISS Companion 2016 - Niagara Falls, Canada|
Duration: Nov 6 2016 → Nov 9 2016
|Name||Companion Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces: Nature Meets Interactive Surfaces, ISS 2016|
|Other||11th Annual ACM International Conference on Interactive Surfaces and Spaces, ISS Companion 2016|
|Period||11/6/16 → 11/9/16|
Bibliographical noteFunding Information:
This work is supported in part by the National Science Foundation (IIS-1218058). Our software utilizes theVRPN library maintained by UNC-Chapel Hill with support from NIH/NCRR and NIH/NIBIB (2P41EB002025).
Copyright 2017 Elsevier B.V., All rights reserved.
- Hybrid 2D/3D User Interfaces
- Immersive 3D Modeling
- Immersive Analytics