The emerging volumetric videos offer a fully immersive, six degrees of freedom (6DoF) viewing experience, at the cost of extremely high bandwidth demand. In this paper, we design, implement, and evaluate Vues, an edge-Assisted transcoding system that delivers high-quality volumetric videos with low bandwidth requirement, low decoding overhead, and high quality of experience (QoE) on mobile devices. Through an IRB-Approved user study, we build a first-of-its-kind QoE model to quantify the impact of various factors introduced by transcoding volumetric content into 2D videos. Motivated by the key observations from this user study, Vues employs a novel multiview approach with the overarching goal of boosting QoE. The Vues edge server adaptively transcodes a volumetric video frame into multiple 2D views with the help of a few lightweight machine learning models and strategically balances the extra bandwidth consumption of additional views and the improved QoE, indicated by our QoE model. The client selects the view that optimizes the QoE among the delivered candidates for display. Comprehensive evaluations using a prototype implementation indicate that Vues dramatically outperforms existing approaches. On average, it improves the QoE by 35% (up to 85%), compared to single-view transcoding schemes, and reduces the bandwidth consumption by 95%, compared to the state-of-The-Art that directly streams volumetric videos.
|Original language||English (US)|
|Title of host publication||ACM MobiCom 2022 - Proceedings of the 2022 28th Annual International Conference on Mobile Computing and Networking|
|Publisher||Association for Computing Machinery|
|Number of pages||14|
|State||Published - Oct 14 2022|
|Event||28th ACM Annual International Conference on Mobile Computing and Networking, MobiCom 2022 - Sydney, Australia|
Duration: Oct 17 2202 → Oct 21 2202
|Name||Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM|
|Conference||28th ACM Annual International Conference on Mobile Computing and Networking, MobiCom 2022|
|Period||10/17/02 → 10/21/02|
Bibliographical noteFunding Information:
We thank the reviewers and our shepherd for their insightful comments. This research was supported in part by NSF Award 1901103, 1915122, 2106090, 2106771, 2128489, and a Cisco research award. The research of Bo Han was funded in part by 4-VA, a collaborative partnership for advancing the Commonwealth of Virginia.
© 2022 ACM.
- edge computing
- mobile mixed reality
- multiview transcoding
- quality-of-experience (QoE)
- volumetric video streaming