Efficient Volumetric Video Streaming through Super Resolution

Anlan Zhang, Chendong Wang, Bo Han, Feng Qian

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Volumetric videos allow viewers to exercise 6-DoF (degrees of freedom) movement when consuming fully 3D content (e.g., point clouds). Due to their truly immersive nature, streaming volumetric videos is highly bandwidth-demanding. In this work, we present to our knowledge a first volumetric video streaming system that leverages 3D super resolution (SR) of point clouds to boost the video quality on commodity devices, and to facilitate the distribution of volumetric content over bandwidth-constrained wireless networks. However, directly applying off-the-shelf 3D SR models leads to unacceptably low performance (∼ 0.1 FPS even on a powerful GPU). To overcome this limitation, we propose a series of optimizations to make SR efficient. Our preliminary results indicate that for an edge-assisted (standalone mobile) setup, a small subset of our proposed optimizations can already drastically improve the FPS by a factor of 131× (53×) and reduce GPU memory usage by 83% (76%), while maintaining the same or even better SR inference accuracy, compared to using an off-the-shelf SR model.

Original languageEnglish (US)
Title of host publicationHotMobile 2021 - Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications
PublisherAssociation for Computing Machinery, Inc
Pages105-110
Number of pages6
ISBN (Electronic)9781450383233
DOIs
StatePublished - Feb 24 2021
Event22nd International Workshop on Mobile Computing Systems and Applications, HotMobile 2021 - Virtual, Online, United Kingdom
Duration: Feb 24 2021Feb 26 2021

Publication series

NameHotMobile 2021 - Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications

Conference

Conference22nd International Workshop on Mobile Computing Systems and Applications, HotMobile 2021
CountryUnited Kingdom
CityVirtual, Online
Period2/24/212/26/21

Bibliographical note

Publisher Copyright:
© 2021 ACM.

Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.

Fingerprint Dive into the research topics of 'Efficient Volumetric Video Streaming through Super Resolution'. Together they form a unique fingerprint.

Cite this