Vues: Practical mobile volumetric video streaming through multiview transcoding

Yu Liu, Bo Han, Feng Qian, Arvind Narayanan, Zhi Li Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The emerging volumetric videos offer a fully immersive, six degrees of freedom (6DoF) viewing experience, at the cost of extremely high bandwidth demand. In this paper, we design, implement, and evaluate Vues, an edge-Assisted transcoding system that delivers high-quality volumetric videos with low bandwidth requirement, low decoding overhead, and high quality of experience (QoE) on mobile devices. Through an IRB-Approved user study, we build a first-of-its-kind QoE model to quantify the impact of various factors introduced by transcoding volumetric content into 2D videos. Motivated by the key observations from this user study, Vues employs a novel multiview approach with the overarching goal of boosting QoE. The Vues edge server adaptively transcodes a volumetric video frame into multiple 2D views with the help of a few lightweight machine learning models and strategically balances the extra bandwidth consumption of additional views and the improved QoE, indicated by our QoE model. The client selects the view that optimizes the QoE among the delivered candidates for display. Comprehensive evaluations using a prototype implementation indicate that Vues dramatically outperforms existing approaches. On average, it improves the QoE by 35% (up to 85%), compared to single-view transcoding schemes, and reduces the bandwidth consumption by 95%, compared to the state-of-The-Art that directly streams volumetric videos.

Original languageEnglish (US)
Title of host publicationACM MobiCom 2022 - Proceedings of the 2022 28th Annual International Conference on Mobile Computing and Networking
PublisherAssociation for Computing Machinery
Pages514-527
Number of pages14
ISBN (Electronic)9781450391818
DOIs
StatePublished - Oct 14 2022
Event28th ACM Annual International Conference on Mobile Computing and Networking, MobiCom 2022 - Sydney, Australia
Duration: Oct 17 2202Oct 21 2202

Publication series

NameProceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM

Conference

Conference28th ACM Annual International Conference on Mobile Computing and Networking, MobiCom 2022
Country/TerritoryAustralia
CitySydney
Period10/17/0210/21/02

Bibliographical note

Funding Information:
We thank the reviewers and our shepherd for their insightful comments. This research was supported in part by NSF Award 1901103, 1915122, 2106090, 2106771, 2128489, and a Cisco research award. The research of Bo Han was funded in part by 4-VA, a collaborative partnership for advancing the Commonwealth of Virginia.

Publisher Copyright:
© 2022 ACM.

Keywords

  • edge computing
  • mobile mixed reality
  • multiview transcoding
  • quality-of-experience (QoE)
  • volumetric video streaming

Fingerprint

Dive into the research topics of 'Vues: Practical mobile volumetric video streaming through multiview transcoding'. Together they form a unique fingerprint.

Cite this