收藏切换
Discovering Coordinated Subtask Patterns from a Graphical Multi-Agent Task Modeling Perspective
收藏切换
Chao Li, Wenbin Li*, Yang Gao
Journal of Computer Research and Development | 2024, 61(8) : 1904 - 1916
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(8): 1904-1916
• Special Issue on Graph Machine Learning •
Discovering Coordinated Subtask Patterns from a Graphical Multi-Agent Task Modeling Perspective
Full
Chao Li, Wenbin Li*, Yang Gao
Affiliations
  • State Key Laboratory for Novel Software Technology (Nanjing University), Nanjing 210023
  • born in 1996. PhD candidate. Student member of CCF. His main research interests include reinforcement learning, multi-agent systems, and task modeling

    born in 1991. PhD, associate researcher. Member of CCF. His main research interests include machine learning, meta learning, and continual learning

    born in 1972. PhD, professor. Committee member of CCF. His main research interests include multi-agent reinforcement learning, game theory, and machine learning

About Author:

born in 1996. PhD candidate. Student member of CCF. His main research interests include reinforcement learning, multi-agent systems, and task modeling

born in 1991. PhD, associate researcher. Member of CCF. His main research interests include machine learning, meta learning, and continual learning

born in 1972. PhD, professor. Committee member of CCF. His main research interests include multi-agent reinforcement learning, game theory, and machine learning

Published: 2024-08-01 doi: 10.7544/issn1000-1239.202440189
Outline
收藏切换

Numerous multi-agent tasks exhibit a nearly decomposable structure, wherein interactions among agents within the same interaction set are strong while interactions between different sets are weak. Efficiently modeling this structure and leveraging it to coordinate agents can enhance the learning efficiency of multi-agent reinforcement learning algorithms for cooperative multi-agent tasks, while existing work typically neglects and fails. To address this limitation, we model the nearly decomposable structure using a dynamic graph and accordingly propose a novel algorithm named coordinated subtask pattern (CSP) that enhances both local and global coordination among agents. Specifically, CSP identifies agents’ interaction sets as subtasks and utilizes a bi-level structure to periodically distribute agents into multiple subtasks, which ensures accurate characterizations regarding their interactions on the dynamic graph. Based on the subtask assignment, CSP proposes intra-subtask and inter-subtask pattern constraints to facilitate both local and global coordination among agents. These two constraints ensure that partial agents within the same subtask are aware of their action selections and all agents select superior joint actions that maximize the overall task performance. Experimentally, we evaluate CSP across multiple maps of SMAC benchmark, and its superior performance against multiple baseline algorithms demonstrates its effectiveness on efficiently coordinating agents.

multi-agent reinforcement learning  /  cooperative tasks  /  nearly decomposable structure  /  dynamic graph  /  coordination
李超, 李文斌, 高阳. 图多智能体任务建模视角下的协作子任务行为发现. 计算机研究与发展, 2024 , 61 (8) : 1904 -1916 . DOI: 10.7544/issn1000-1239.202440189
Chao Li, Wenbin Li, Yang Gao. Discovering Coordinated Subtask Patterns from a Graphical Multi-Agent Task Modeling Perspective[J]. Journal of Computer Research and Development, 2024 , 61 (8) : 1904 -1916 . DOI: 10.7544/issn1000-1239.202440189
Year 2024 volume 61 Issue 8
67
30
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440189
  • Receive Date:2024-03-16
  • Online Date:2026-11-17
  • Published:2024-08-01
Article Data
Affiliations
History
  • Received:2024-03-16
  • Revised:2024-05-10
Affiliations
    State Key Laboratory for Novel Software Technology (Nanjing University), Nanjing 210023
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440189
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT