基于深度强化学习的边缘辅助视频分析任务卸载

DEEP REINFORCEMENT LEARNING-BASED EDGE-ASSISTED VIDEO ANALYTICS OFFLOADING

  • 摘要: 随着深度学习的发展,人工智能相关的服务和应用大规模出现,包括推荐系统、视频分析等,它们对高算力、高带宽、低时延都提出了更高的要求,边缘计算目前被认为是最合适的计算方式。该文研究了多用户边缘辅助视频分析任务卸载 (Multi-user Edge-assisted Video Analytics task Offloading, MEVAO) 问题,其中不同视频分析任务的用户将独立选择满足自身需求的准确度决策,并将视频数据卸载到边缘服务器上。针对此问题,提出一种基于深度强化学习的算法。根据视频分析特点设计效用函数,将 MEVAO 建模为博弈论问题并求解纳什均衡;然后应用深度强化学习方法提高了在不同场景下做出准确度决策的灵活性。实验结果表明,所提算法相较现有算法具有更好的性能表现。

     

    Abstract: With the development of deep learning, AI-related services and applications have emerged on a large scale, including recommendation systems, video analytics, etc. They all place higher demands on high computing power, high bandwidth, and low latency. Edge computing is now considered to be the most suitable way. In this paper, we consider Multi-user edge-assisted video analytics task offloading (MEVAO) problem, in which all users with different video analytics tasks independently choose their accuracy decisions that satisfy their requirements and then offload the video data to the edge server. In view of this, we propose a deep reinforcement learning approach. The algorithm designed a utility function based on the feature of video analysis, modeled MEVAO as a game theory problem, and achieved the Nash equilibrium. The deep reinforcement learning approach was applied to improve the flexibility of making accurate decisions in different scenarios. Experimental results show that our algorithm has a better performance compared with other existing methods.

     

/

返回文章
返回