收藏切换
Optimization of Multi-Agent Handover Based on Team Model in C-V2X Environments
收藏切换
Bingyi Liu1, 2, Dongdong Wang1, Haiyong Shi1, Enshu Wang3, *, Libing Wu3, Jianping Wang4
Journal of Computer Research and Development | 2024, 61(11) : 2806 - 2820
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(11): 2806-2820
• Special Issue on Advanced Technologies of Artificial Intelligence of Things •
Optimization of Multi-Agent Handover Based on Team Model in C-V2X Environments
Full
Bingyi Liu1, 2, Dongdong Wang1, Haiyong Shi1, Enshu Wang3, *, Libing Wu3, Jianping Wang4
Affiliations
  • 1School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan 430070
  • 2Sanya Science and Education Innovation Park, Wuhan University of Technology, Sanya, Hainan 572000
  • 3School of Cyber Science and Engineering, Wuhan University, Wuhan 430070
  • 4Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong
  • born in 1990. PhD, professor and PhD supervisor. His main research interests include wireless networking, vehicular networking, autonomous driving, and Internet of things

    born in 2000. Master candidate. His main research interests include vehicular networking, autonomous driving, and reinforcement learning

    born in 1998. PhD candidate. His main research interests include vehicular networking, autonomous driving, and reinforcement learning

    born in 1990. PhD, associate professor. His main research interests include vehicular networking, autonomous driving, and reinforcement learning

    born in 1970. PhD, professor, PhD supervisor. Distinguished member of CCF. His main research interests include autonomous driving, distributed computing, network security, and wireless sensor networks

    born in 1975. PhD, professor. IEEE Fellow and AAIA Fellow. Her main research interests include autonomous driving, reliable Internet, cloud computing, optical networks, and service-oriented networks and data center networking

About Author:

born in 1990. PhD, professor and PhD supervisor. His main research interests include wireless networking, vehicular networking, autonomous driving, and Internet of things

born in 2000. Master candidate. His main research interests include vehicular networking, autonomous driving, and reinforcement learning

born in 1998. PhD candidate. His main research interests include vehicular networking, autonomous driving, and reinforcement learning

born in 1990. PhD, associate professor. His main research interests include vehicular networking, autonomous driving, and reinforcement learning

born in 1970. PhD, professor, PhD supervisor. Distinguished member of CCF. His main research interests include autonomous driving, distributed computing, network security, and wireless sensor networks

born in 1975. PhD, professor. IEEE Fellow and AAIA Fellow. Her main research interests include autonomous driving, reliable Internet, cloud computing, optical networks, and service-oriented networks and data center networking

Published: 2024-11-01 doi: 10.7544/issn1000-1239.202440404
Outline
收藏切换

Cellular vehicle-to-everything (C-V2X) communication technology is a crucial component of future intelligent transportation systems (ITS). Millimeter wave (mmWave), as one of the primary carriers for C-V2X technology, offers high bandwidth to users. However, due to limited propagation distance and sensitivity to obstructions, mmWave base stations must be densely deployed to maintain reliable communication. This requirement causes intelligent connected vehicle (ICV) to frequently switch communications during travel, easily leading to local resource shortages, thus degrading service quality and user experience. To address these challenges, we treat each ICV as an agent and model the ICV communication switching issue as a cooperative multi-agent game problem. To solve this problem, we propose a cooperative reinforcement learning framework based on a teammate model. Specifically, we design a teammate model to quantify the interdependencies among agents in complex dynamic environments. Furthermore, we propose a dynamic weight allocation scheme that generates weighted mutual information among teammates for the input of the mixing network, aiming to assist teammates in switching to base stations that provide satisfactory QoS and QoE, thereby achieving high throughput and low communication switching frequency. During the algorithm training process, we design an incentive-compatible training algorithm aimed at aligning the individual goals of the agents with collective goals, enhancing communication throughput. Experimental results demonstrate that this algorithm achieves a 13.8% to 38.2% increase in throughput compared with existing communication benchmark algorithms.

C-V2X  /  resource allocation  /  handover  /  multi-agent reinforcement learning  /  cooperative multi-agent reinforcement learning
刘冰艺, 王东东, 施海勇, 王恩澍, 吴黎兵, 汪建平. C-V2X环境下基于队友模型的多智能体通信切换优化. 计算机研究与发展, 2024 , 61 (11) : 2806 -2820 . DOI: 10.7544/issn1000-1239.202440404
Bingyi Liu, Dongdong Wang, Haiyong Shi, Enshu Wang, Libing Wu, Jianping Wang. Optimization of Multi-Agent Handover Based on Team Model in C-V2X Environments[J]. Journal of Computer Research and Development, 2024 , 61 (11) : 2806 -2820 . DOI: 10.7544/issn1000-1239.202440404
Year 2024 volume 61 Issue 11
79
38
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440404
  • Receive Date:2024-05-31
  • Online Date:2026-11-17
  • Published:2024-11-01
Article Data
Affiliations
History
  • Received:2024-05-31
  • Revised:2024-07-31
Affiliations
    1School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan 430070
    2Sanya Science and Education Innovation Park, Wuhan University of Technology, Sanya, Hainan 572000
    3School of Cyber Science and Engineering, Wuhan University, Wuhan 430070
    4Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440404
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT