QoE-driven optimization for cloud-assisted DASH-based scalable interactive multiview video streaming over wireless network

In interactive multiview video streaming (IMVS), the viewers can periodically switch viewpoints. If the captured view is not available at the desired viewpoint, virtual views can be rendered from neighboring coded views using view synthesis techniques. Dynamic adaptive streaming over HTTP (DASH) is a new standard that allows to adjust the quality of video streaming based on the network condition. In this paper, an improved DASH-based IMVS framework is proposed. It has the following characteristics. First, virtual views could be adaptively generated at either the cloud-based server or the client in our scheme, depending on the network condition and the cost of the cloud. Second, scalable video coding (SVC) is used to improve the flexibility in our system. To optimize the Quality of Experience (QoE) of multiple clients in wireless scenario, we develop a cross-layer optimization scheme. We first propose a new cache management method to selectively store the video data according to SVC structure and the clients’ requesting condition. Next, a cross-layer scheduling scheme is proposed by considering the video rate adaptation and the wireless resource allocation. The optimization problem is shown to be equivalent to the Multiple Choice Knapsack (MCKP) problem. A dynamic programming method and a low-cost greedy method are developed to solve the problem. Simulations with the NS3 tool demonstrate the advantage of our proposed scheme over the existing approach that always uses client-based view synthesis and single-layer video coding. •A Cloud-assisted DASH-based Scalable Interactive Multiview Video Streaming system is proposed.•An adaptive view synthesis method is designed for the CDS-IMVS client.•A cross-layer system is developed to improve QoE of multiple CDS-IMVS users in LTE network.•A cache management method is designed to reduce the cloud cost based on the SVC structure.•We design a cross-layer bitrate scheduling method by considering the media bitrate and wireless adaptation.