Volumetric videos allow viewers to exercise 6-DoF (degrees of freedom) movement when consuming fully 3D content (e.g., point clouds). Due to their truly immersive nature, streaming volumetric videos is highly bandwidth-demanding. In this work, we present to our knowledge a first volumetric video streaming system that leverages 3D super resolution (SR) of point clouds to boost the video quality on commodity devices, and to facilitate the distribution of volumetric content over bandwidth-constrained wireless networks. However, directly applying off-the-shelf 3D SR models leads to unacceptably low performance (∼ 0.1 FPS even on a powerful GPU). To overcome this limitation, we propose a series of optimizations to make SR efficient. Our preliminary results indicate that for an edge-assisted (standalone mobile) setup, a small subset of our proposed optimizations can already drastically improve the FPS by a factor of 131× (53×) and reduce GPU memory usage by 83% (76%), while maintaining the same or even better SR inference accuracy, compared to using an off-the-shelf SR model.
|Original language||English (US)|
|Title of host publication||HotMobile 2021 - Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications|
|Publisher||Association for Computing Machinery, Inc|
|Number of pages||6|
|State||Published - Feb 24 2021|
|Event||22nd International Workshop on Mobile Computing Systems and Applications, HotMobile 2021 - Virtual, Online, United Kingdom|
Duration: Feb 24 2021 → Feb 26 2021
|Name||HotMobile 2021 - Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications|
|Conference||22nd International Workshop on Mobile Computing Systems and Applications, HotMobile 2021|
|Period||2/24/21 → 2/26/21|
Bibliographical notePublisher Copyright:
© 2021 ACM.
Copyright 2021 Elsevier B.V., All rights reserved.