Virtual Content Creation Using Dynamic Omnidirectional Texture Synthesis

Chih Fan Chen, Evan Suma Rosenberg

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

We present a dynamic omnidirectional texture synthesis (DOTS) approach for generating real-Time virtual reality content captured using a consumer-grade RGB-D camera. Compared to a single fixed-viewpoint color map, view-dependent texture mapping (VDTM) techniques can reproduce finer detail and replicate dynamic lighting effects that become especially noticeable with head tracking in virtual reality. However, VDTM is very sensitive to errors such as missing data or inaccurate camera pose estimation, both of which are commonplace for objects captured using consumer-grade RGB-D cameras. To overcome these limitations, our proposed optimization can synthesize a high resolution view-dependent texture map for any virtual camera location. Synthetic textures are generated by uniformly sampling a spherical virtual camera set surrounding the virtual object, thereby enabling efficient real-Time rendering for all potential viewing directions.

Original languageEnglish (US)
Title of host publication25th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018 - Proceedings
EditorsFrank Steinicke, Bruce Thomas, Kiyoshi Kiyokawa, Greg Welch
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages521-522
Number of pages2
ISBN (Print)9781538633656
DOIs
StatePublished - Aug 24 2018
Externally publishedYes
Event25th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018 - Reutlingen, Germany
Duration: Mar 18 2018Mar 22 2018

Publication series

Name25th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018 - Proceedings

Other

Other25th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018
Country/TerritoryGermany
CityReutlingen
Period3/18/183/22/18

Bibliographical note

Funding Information:
This work is sponsored by the U.S. Army Research Laboratory (ARL) under contract number W911NF-14-D-0005. Statements

Keywords

  • content creation
  • view-dependent texture mapping
  • virtual reality

Fingerprint

Dive into the research topics of 'Virtual Content Creation Using Dynamic Omnidirectional Texture Synthesis'. Together they form a unique fingerprint.

Cite this