Edge Cloud Resource Scheduling with Deep Reinforcement Learning

dc.contributor.authorFeng, Y.
dc.contributor.authorLi, M.
dc.contributor.authorLi, J.
dc.contributor.authorYu, Y.
dc.coverage.issue1cs
dc.coverage.volume34cs
dc.date.accessioned2025-04-10T12:13:02Z
dc.date.available2025-04-10T12:13:02Z
dc.date.issued2025-04cs
dc.description.abstractDesigning optimal scheduling algorithms for task allocation in edge cloud clusters presents significant challenges due to the constantly changing workloads and service requests in edge cloud data center environments. These challenges stem from the need to manage the vast amounts of information transmitted by IoT devices, as well as the necessity of offloading computational tasks to cloud data centers. To tackle this issue, we propose a novel deep reinforcement learning-based resource allocation method called Decima#, which offers an effective resource optimization solution for edge cloud data centers. We utilize a transformer architecture to capture resource states on directed acyclic graphs (DAGs), accelerating the aggregation speed of the Graph Neural Network (GNN). Moreover, we develop innovative reward functions and concurrent processing mechanisms to minimize training time. Furthermore, we enhance the Proximal Policy Optimization (PPO) algorithm to improve adaptability, increase the accuracy of likelihood ratio estimation, identify a more suitable activation function, and impose constraints on gradient updates. In simulation environments, Decima# reduced the average job duration by 19% compared to the Decima algorithm, while also achieving a 56% increase in training convergence speed. Code has been made available at https://github.com/limengzhaolihai/spark-decimasharp-ppog.en
dc.formattextcs
dc.format.extent92-108cs
dc.format.mimetypeapplication/pdfen
dc.identifier.citationRadioengineering. 2025 vol. 34, iss. 1, s. 92-108. ISSN 1210-2512cs
dc.identifier.doi10.13164/re.2025.0092en
dc.identifier.issn1210-2512
dc.identifier.urihttps://hdl.handle.net/11012/250864
dc.language.isoencs
dc.publisherRadioengineering Societycs
dc.relation.ispartofRadioengineeringcs
dc.relation.urihttps://www.radioeng.cz/fulltexts/2025/25_01_0092_0108.pdfcs
dc.rightsCreative Commons Attribution 4.0 International licenseen
dc.rights.accessopenAccessen
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en
dc.subjectEdge computingen
dc.subjectdeep reinforcement learningen
dc.subjectresource schedulingen
dc.titleEdge Cloud Resource Scheduling with Deep Reinforcement Learningen
dc.type.driverarticleen
dc.type.statusPeer-revieweden
dc.type.versionpublishedVersionen
eprints.affiliatedInstitution.facultyFakulta elektrotechniky a komunikačních technologiícs
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
25_01_0092_0108.pdf
Size:
12.37 MB
Format:
Adobe Portable Document Format
Description:
Collections