在线时间:8:00-16:00
迪恩网络APP
随时随地掌握行业动态
扫描二维码
关注迪恩网络微信公众号
开源软件名称:FedLive开源软件地址:https://gitee.com/uglyghost123/FedLive开源软件介绍:FedLive: A Federated Transmission Framework for Panoramic Livecast with Reinforced Variational Inference1. AbstractProviding premium panoramic livecast services for worldwide viewers against the negative effects of its ultra-high data rate and delay-sensitive demands is still a significant challenge to the current delivery system. Therefore, it is imperative to explore an efficient way of improving the quality of experience while conserving the bandwidth resources for panoramic livecast. This paper expends the design space of both the Field of View (FoV) prediction and the multi-viewers 360◦ live streaming by presenting a novel cost-efficient federated transmission framework called FedLive. We first propose a gradient-based clustering method to group the geo-distributed viewers with similar viewing behavior into content delivery alliances by exploiting geometric properties of the gradient loss. With viewers’ resources integration, a Reinforced Variational Inference (RVI) structure-based approach is proposed to assist in the collaborative training of the FoV prediction model while accelerating multiple multi-rate tiles delivery. We further design a prediction-based asynchronous delivery algorithm, in which both the high accuracy FoV prediction and efficient live 360◦ video transmission are achieved in a decentralized manner. Finally, we use the synchronized algorithm as a benchmark to evaluate our solution performance over a real-world dataset. Additionally, prototype-based experimental results reveal that our approach provides the highest prediction accuracy, reduces delay, and saves bandwidth compared with state-of-the-art solutions. 2. FrameworkThe above figure presents the diagram of FedLive, the proposed federated transmission framework for PLS. In FedLive multiple types of nodes are involved, including content providers, CDN servers, and viewers with HMDs.FedLive contains two major phases including distributed learning phase and transmission phase with three blocks (viewers side, CDN servers side, and content provider side).This repository introduces distributed learning phase. In the distributed learning phase, each viewer trains a local FoV prediction model with inputs of its local viewing records and prefetching records provided by the FoV prediction model.The loss information as the output will be used for the local backward propagation and will also be captured by the nearby CDN servers as the input of the user clustering algorithm.Especially, the loss matrix is calculated by adding the predicted FoV binary matrix to the ground truth binary matrix.Once the CDN servers have collected the loss information from all viewers, they will invoke the gradient-based user clustering algorithm to divide the viewers into multiple viewer clusters.Meanwhile, the CDN servers continuously summarize the loss value for each cluster and update it to the content provider along with the clustering results as the input for the unified model training.With the loss information provided by the CDN servers, the content provider updates the unified model for each cluster with the weighted average loss value.The process extends the concept of federated learning by adding clustering.Further, the unified models will be distributed to viewers as part of the live streaming,while the prefetching priority of different tiles is determined corresponding to the predicted results of the unified models. 3. Installation3.1 Install dependent packagesWe build FedLive with Torch+Gym. You can install as follow:
3.2 Download FedLiveFirst of all, you should download FedLive from Github: git clone https://gitee.com/uglyghost123/FedLive.git 4. How To Use4.1 Folders
4.2 Prepare the datasets
python get_frames.py
4.3 Run with SAC policy
python main.py --policy SAC 5. Selected Results5.1 Viewing experiencewith the custom environment "grid_video_world.py"
5.2 Accuracy, precision, and recallFurther, we evaluate the performance of our solution in terms of prediction accuracy, precision, and recall and we compare it with that of three state-of-the-art solutions: LiveDeep, LiveObj, and PanoSalNet, in an asynchronous manner. 5.3 The objective function (as QoE performance)6. Contributors7. CitationContactXingyan Chen ([email protected]), Southwestern University of Finance and Economics |
请发表评论