收藏切换
Method to Create Aggregate Tree for Hardware Supported Collectives
收藏切换
Shuping Chen, Hongmei Wei, Fei Wang, Yi Li, Wangquan He, Fengbin Qi*
Journal of Computer Research and Development | 2024, 61(2) : 503 - 517
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(2): 503-517
• Network Technology •
Method to Create Aggregate Tree for Hardware Supported Collectives
Full
Shuping Chen, Hongmei Wei, Fei Wang, Yi Li, Wangquan He, Fengbin Qi*
Affiliations
  • 1National Research Center of Parallel Computer Engineering & Technology, Beijing 100190
  • born in 1983. PhD, associate professor. His main research interests include high performance computing and interconnect networks

    born in 1968. professor, PhD supervisor. Member of CCF. Her research interests include parallel computing and parallel compilation

    born in 1981. Associate professor. His research interests include compiler design and optimization, and artificial intelligence

    born in 1994. Master, engineer. Her main research interests include high performance computing and high-speed interconnect networks

    born in 1975. PhD, professor. His research interests include parallel programming language design and compiler optimization

    born in 1966. Professor, PhD supervisor. Fellow of CCF. His research interests include high performance computing architecture, compiler optimization, and parallel algorithm

About Author:

born in 1983. PhD, associate professor. His main research interests include high performance computing and interconnect networks

born in 1968. professor, PhD supervisor. Member of CCF. Her research interests include parallel computing and parallel compilation

born in 1981. Associate professor. His research interests include compiler design and optimization, and artificial intelligence

born in 1994. Master, engineer. Her main research interests include high performance computing and high-speed interconnect networks

born in 1975. PhD, professor. His research interests include parallel programming language design and compiler optimization

born in 1966. Professor, PhD supervisor. Fellow of CCF. His research interests include high performance computing architecture, compiler optimization, and parallel algorithm

Published: 2024-02-02 doi: 10.7544/issn1000-1239.202220684
Outline
收藏切换

Traditional MPI (message passing interface) collectives are implemented by point-to-point messages, and have poor performance. Hardware supported collectives have attracted more and more attention due to their high performance and low CPU utilization. Aggregate tree has crucial impact on the performance of hardware supported collectives. We study the factors that affect the performance of hardware supported collectives, and propose a cost model for hardware supported collectives and an efficient method to create aggregate trees. The method includes three parts. Firstly, we choose appropriate aggregate tree type and breadth according to the operation type and the size of aggregate messages to do tradeoff between network transmission time and data processing time. Secondly, we propose a method to create hierarchical minimum height aggregate tree of type Ⅰ, which reduces the number of inter-group communication. Thirdly, we put forward a method to create the minimum cost aggregate tree of type Ⅱ, which minimizes the number of used switches. In the Sunway interconnection network, we test the proposals. In the presence of network noise, the message latency of the hierarchical minimum height aggregate tree of type Ⅰ is reduced by 24%−89% compared with that of the traditional method. The aggregate entries used by the minimum cost aggregate tree of type Ⅱ for typical communication patterns are reduced by 90% compared with that of the traditional method.

MPI collectives  /  aggregate tree  /  cost model  /  high-speed interconnect  /  high-performance computing
陈淑平, 尉红梅, 王飞, 李祎, 何王全, 漆锋滨. 硬件集合通信中聚合树构建方法. 计算机研究与发展, 2024 , 61 (2) : 503 -517 . DOI: 10.7544/issn1000-1239.202220684
Shuping Chen, Hongmei Wei, Fei Wang, Yi Li, Wangquan He, Fengbin Qi. Method to Create Aggregate Tree for Hardware Supported Collectives[J]. Journal of Computer Research and Development, 2024 , 61 (2) : 503 -517 . DOI: 10.7544/issn1000-1239.202220684
Year 2024 volume 61 Issue 2
74
34
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202220684
  • Receive Date:2022-08-08
  • Online Date:2026-11-17
  • Published:2024-02-02
Article Data
Affiliations
History
  • Received:2022-08-08
  • Revised:2023-04-06
Affiliations
    1National Research Center of Parallel Computer Engineering & Technology, Beijing 100190
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202220684
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT