收藏切换
Multi-Agent Reinforcement Learning Based Online Scheduling for Multi-DNN Workloads on Multi-Chiplet Accelerators
收藏切换
Chenjiu Wang1, 2, Zhimeng Zhang1, 2, Qinfen Hao1, *
Journal of Computer Research and Development | 2026, 63(8) : 2005 - 2023
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(8): 2005-2023
• Special Issue on AI Computility: Systems and Key Applications •
Multi-Agent Reinforcement Learning Based Online Scheduling for Multi-DNN Workloads on Multi-Chiplet Accelerators
Full
Chenjiu Wang1, 2, Zhimeng Zhang1, 2, Qinfen Hao1, *
Affiliations
  • 1State Key Lab of Processors (Institute of Computing Technology, Chinese Academy of Sciences), Beijing 100190
  • 2University of Chinese Academy of Sciences, Beijing 100049
  • born in 1998. PhD candidate. Student member of CCF. His main research interests include deep learning accelerators and wafer-scale systems

    born in 1999. PhD candidate. His main research interests include neural networks and wafer-scale systems

    born in 1969. PhD, professor. Distinguished member of CCF, senior member of IEEE. His main research interests include computer architecture, Chiplet-based processor design, and wafer-scale computing systems

About Author:

born in 1998. PhD candidate. Student member of CCF. His main research interests include deep learning accelerators and wafer-scale systems

born in 1999. PhD candidate. His main research interests include neural networks and wafer-scale systems

born in 1969. PhD, professor. Distinguished member of CCF, senior member of IEEE. His main research interests include computer architecture, Chiplet-based processor design, and wafer-scale computing systems

Published: 2026-08-01 doi: 10.7544/issn1000-1239.202660134
Outline
收藏切换

With the increasing popularity of deep neural network (DNN) applications, Chiplet-based accelerators have become critical infrastructure for supporting large-scale DNN inference services on server platforms. However, the real-time and dynamic characteristics of parallel multi-DNN workloads pose severe challenges to scheduling algorithms, while existing algorithms suffer from limitations in decision overhead, service level agreement (SLA) assurance, and dynamic adaptability. To address these issues, we propose MAOSA, a multi-agent reinforcement learning based online scheduling algorithm for multi-DNN workloads on multi-Chiplet accelerators, aiming to maximize the overall SLA satisfaction rate. The proposed algorithm partitions DNN tasks into DNN blocks and models them as agents. It utilizes the attention mechanism to generate scheduling strategies in parallel, which include execution order and PE-level resource allocation, thereby significantly reducing decision overhead. Furthermore, a cooperative reward function considering time slack is designed to optimize SLA, and a periodic unified preemption mechanism is introduced to adapt to dynamic load changes. Experimental results show that, compared with state-of-the-art algorithms, the proposed algorithm improves the SLA satisfaction rate by up to 18% and system throughput (STP) by 31.9%, reduces tail latency by 28.7%, and decreases scheduling execution time by a factor of approximately 11, effectively enhancing system performance and service quality.

deep neural network  /  Chiplet  /  multi-agent reinforcement learning  /  online scheduling  /  service level agreement
王晨赳, 张志锰, 郝沁汾. 基于多智能体强化学习的多Chiplet加速器多DNN负载的在线调度. 计算机研究与发展, 2026 , 63 (8) : 2005 -2023 . DOI: 10.7544/issn1000-1239.202660134
Chenjiu Wang, Zhimeng Zhang, Qinfen Hao. Multi-Agent Reinforcement Learning Based Online Scheduling for Multi-DNN Workloads on Multi-Chiplet Accelerators[J]. Journal of Computer Research and Development, 2026 , 63 (8) : 2005 -2023 . DOI: 10.7544/issn1000-1239.202660134
Year 2026 volume 63 Issue 8
96
46
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202660134
  • Receive Date:2026-03-04
  • Online Date:2026-11-17
  • Published:2026-08-01
Article Data
Affiliations
History
  • Received:2026-03-04
  • Revised:2026-04-28
Affiliations
    1State Key Lab of Processors (Institute of Computing Technology, Chinese Academy of Sciences), Beijing 100190
    2University of Chinese Academy of Sciences, Beijing 100049
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202660134
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT