成果归属机构:
作者:
Zhang, Yaqiang ; Li, Ruyang ; Zhao, Yaqian ; Li, Rengang ; Wang, Yanwei ; Zhou, Zhangbing
单位:
Inspur Beijing Elect Informat Ind Co Ltd, Beijing 100085, Peoples R China;Inspur Elect Informat Ind Co Ltd, Jinan 250101, Peoples R China;Shandong Mass Informat Technol Res Inst, Jinan 250101, Peoples R China;China Univ Geosci Beijing, Sch Informat Engn, Beijing 100083, Peoples R China
关键词:
EFFICIENT RESOURCE-ALLOCATION; MOBILITY-AWARE; SECURITY; WORKFLOW; INTERNET; SYSTEMS; CLOUD
摘要:
Edge computing as a complementary paradigm of cloud computing has gained more attention by providing mobile users with diversified services at the network edge. However, the increasingly complex mobile applications put a heavier load on edge networks. It is challenging to provide concurrency requests with high-quality service processing, especially when the edge networks are dynamically changing. To address the above issues, this paper investigates the online concurrent user requests scheduling optimization problem in edge cooperation networks. We model it as an online multi-stage decision-making problem, where requests are divided into a group of independent and logically related sub-tasks. We proposed a centralized training distributed execution based multi-agent deep reinforcement learning technique to realize the implicit cooperation scheduling decision-making policy learning among edge nodes. At the centralized training stage of the proposed mechanism, a value-decomposition-based policy learning technique is adopted to improve the long-term system per-formance, while at the distributed execution stage, only local environment status information is needed for each edge node to make the request scheduling decision. Extensive experiments are conducted, and simulation results demonstrate that the proposed mechanism outperforms other request scheduling mechanisms in reducing the long-term average system delay and energy consumption while improving the throughput rate of the system.(c) 2022 Elsevier B.V. All rights reserved.
基金:
Shandong Provincial Natural Sci-ence Foundation, China; [ZR2021QF104]
语种:
英文
来源:
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE,2023():258-268.
出版日期:
2023-04
提交日期:
2023-02-18
引用参考:
Zhang, Yaqiang; Li, Ruyang; Zhao, Yaqian; Li, Rengang; Wang, Yanwei; Zhou, Zhangbing. Multi-agent deep reinforcement learning for online request scheduling in edge cooperation networks[J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE,2023():258-268.