Rapid creation of photorealistic virtual reality content with consumer depth cameras

Chih Fan Chen, Mark Bolas, Evan Suma Rosenberg

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations


Virtual objects are essential for building environments in virtual reality (VR) applications. However, creating photorealistic 3D models is not easy, and handcrafting the detailed 3D model from a real object can be time and labor intensive. An alternative way is to build a structured camera array such as a light-stage to reconstruct the model from a real object. However, these technologies are very expensive and not practical for most users. In this work, we demonstrate a complete end-to-end pipeline for the capture, processing, and rendering of view-dependent 3D models in virtual reality from a single consumer-grade RGB-D camera. The geometry model and the camera trajectories are automatically reconstructed from a RGB-D image sequence captured offline. Based on the HMD position, selected images are used for real-time model rendering. The result of this pipeline is a 3D mesh with view-dependent textures suitable for real-time rendering in virtual reality. Specular reflections and light-burst effects are especially noticeable when users view the objects from different perspectives in a head-tracked environment.

Original languageEnglish (US)
Title of host publication2017 IEEE Virtual Reality, VR 2017 - Proceedings
PublisherIEEE Computer Society
Number of pages2
ISBN (Electronic)9781509066476
StatePublished - Apr 4 2017
Externally publishedYes
Event19th IEEE Virtual Reality, VR 2017 - Los Angeles, United States
Duration: Mar 18 2017Mar 22 2017


Other19th IEEE Virtual Reality, VR 2017
Country/TerritoryUnited States
CityLos Angeles


  • Augmented
  • H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems - Artificial
  • I.2.10 [Computing Methodologies]: Vision and Scene Understanding - 3D/stereo scene analysis
  • I.3.7 [Computing Methodologies]: Three-Dimensional Graphics and Realism - Color
  • Shading
  • Shadowing
  • Texture
  • Virtual realities


Dive into the research topics of 'Rapid creation of photorealistic virtual reality content with consumer depth cameras'. Together they form a unique fingerprint.

Cite this