A Two-Tier System for On-Demand Streaming of 360 Degree Video over Dynamic Networks

Liyang Sun, Fanyi Duanmu, Yong Liu, Yao Wang, Yinghua Ye, Hang Shi, David Dai

Research output: Contribution to journalArticlepeer-review

Abstract

360° video on-demand streaming is a key component of the emerging virtual reality and augmented reality applications. In such applications, sending the entire 360° video demands extremely high network bandwidth that may not be affordable by today's networks. On the other hand, sending only the predicted user's field of view (FoV) is not viable as it is hard to achieve perfect FoV prediction in on-demand streaming, where it is better to prefetch the video multiple seconds ahead, to absorb the network bandwidth fluctuation. This paper proposes a two-tier solution, where the base tier delivers the entire 360° span at a lower quality with a long prefetching buffer, and the enhancement tier delivers the predicted FoV at a higher quality using a short buffer. The base tier provides robustness to both network bandwidth variations and FoV prediction errors. The enhancement tier improves the video quality if it is delivered in time and FoV prediction is accurate. We study the optimal rate allocation between the two tiers and buffer provisioning for the enhancement tier to achieve the optimal trade-off between video quality and streaming robustness. We also design periodic and adaptive optimization frameworks to adapt to the bandwidth variations and FoV prediction errors in realtime. Through simulations driven by real LTE and WiGig network bandwidth traces and user FoV traces, we demonstrate that the proposed two-tier systems can achieve a high-level of quality-of-experience in the face of network bandwidth and user FoV dynamics.

Original languageEnglish (US)
Article number8640123
Pages (from-to)43-57
Number of pages15
JournalIEEE Journal on Emerging and Selected Topics in Circuits and Systems
Volume9
Issue number1
DOIs
StatePublished - Mar 2019

Keywords

  • 360° video
  • on-demand video streaming
  • virtual reality

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'A Two-Tier System for On-Demand Streaming of 360 Degree Video over Dynamic Networks'. Together they form a unique fingerprint.

Cite this