论文标题

视频流服务中连续QOE预测的卷积神经网络

Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services

论文作者

Duc, Tho Nguyen, Tran, Chanh Minh, Tan, Phan Xuan, Kamioka, Eiji

论文摘要

在视频流服务中,预测连续的用户体验质量(QOE)在向用户提供高质量流媒体内容方面起着至关重要的作用。但是,QoE数据中的时间依赖性以及QoE影响因素之间的非线性关系引起的复杂性引入了挑战,以持续QOE预测。为了解决这个问题,现有的研究利用了长期的短期记忆模型(LSTM)有效地捕获这种复杂的依赖性,从而产生了出色的QOE预测准确性。但是,由其架构中的顺序处理特征引起的LSTM的高计算复杂性提出了一个严重的问题,即其在计算能力有限的设备上的性能。同时,最近已经提出了卷积神经网络的变体的时间卷积网络(TCN)用于序列建模任务(例如,语音增强),在预测准确性和计算复杂性方面提供了超过包括基线方法的卓越预测性能。在本文中,提出了一种改进的基于TCN的模型,即CNN-QOE,以连续预测QoE,从而提出了顺序数据的特征。提出的模型利用TCN的优势克服了基于LSTM的QOE模型的计算复杂性缺陷,同时介绍了其架构的改进以提高QoE预测准确性。根据全面的评估,我们证明了提出的CNN-QOE模型可以在个人计算机和移动设备上达到最先进的性能,从而表现出色。

In video streaming services, predicting the continuous user's quality of experience (QoE) plays a crucial role in delivering high quality streaming contents to the user. However, the complexity caused by the temporal dependencies in QoE data and the non-linear relationships among QoE influence factors has introduced challenges to continuous QoE prediction. To deal with that, existing studies have utilized the Long Short-Term Memory model (LSTM) to effectively capture such complex dependencies, resulting in excellent QoE prediction accuracy. However, the high computational complexity of LSTM, caused by the sequential processing characteristic in its architecture, raises a serious question about its performance on devices with limited computational power. Meanwhile, Temporal Convolutional Network (TCN), a variation of convolutional neural networks, has recently been proposed for sequence modeling tasks (e.g., speech enhancement), providing a superior prediction performance over baseline methods including LSTM in terms of prediction accuracy and computational complexity. Being inspired of that, in this paper, an improved TCN-based model, namely CNN-QoE, is proposed for continuously predicting the QoE, which poses characteristics of sequential data. The proposed model leverages the advantages of TCN to overcome the computational complexity drawbacks of LSTM-based QoE models, while at the same time introducing the improvements to its architecture to improve QoE prediction accuracy. Based on a comprehensive evaluation, we demonstrate that the proposed CNN-QoE model can reach the state-of-the-art performance on both personal computers and mobile devices, outperforming the existing approaches.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源