Transitions of viewport quality adaptation mechanisms in 360 degree video streaming

Abstract

Virtual reality has been gaining popularity in recent years fueled by the proliferation of affordable consumer-grade devices such as Oculus Rift, HTC Vive, and Samsung VR. Amongst the various VR applications, 360° video streaming is currently one of the most popular ones. However, it poses a series of challenges to the serving content distribution systems. One challenge is the significantly increased bandwidth requirement for streaming such content in real time. Recent research has shown that only streaming the content that is in the user's (field-of-view) FoV in high quality can lead to strong bandwidth savings. This can be achieved by analyzing the viewers head orientation and movement based on sensor information. Alternatively, historic information from users that watched the content in the past can be considered to prefetch 360° video data in high quality assuming the viewer will direct the FoV to these areas. This paper presents a 360° video streaming system that transitions between sensor- and content-based predictive mechanisms. We evaluate the effects of our system on the Quality of Experience (QoE) of such a VR streaming system and show that the perceived quality can be increased between 50% and 80% compared to systems that only apply either one of the two approaches.