收藏切换
Direct xPU: A Novel Distributed Heterogeneous Computing Architecture Optimized for Inter-node Communication Optimization
收藏切换
Rengang Li1, 2, Yanwei Wang2, Rui Hao2, Linge Xiao2, Le Yang3, *, Guangwen Yang1, Hongwei Kan3
Journal of Computer Research and Development | 2024, 61(6) : 1388 - 1400
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(6): 1388-1400
• Special lssue on Cross-layer Optimization of Processor Chips •
Direct xPU: A Novel Distributed Heterogeneous Computing Architecture Optimized for Inter-node Communication Optimization
Full
Rengang Li1, 2, Yanwei Wang2, Rui Hao2, Linge Xiao2, Le Yang3, *, Guangwen Yang1, Hongwei Kan3
Affiliations
  • 1Department of Computer Science and Technology, Tsinghua University, Beijing 100084
  • 2Inspur (Beijing) Electronic Information Industry Co., Ltd, Beijing 100085
  • 3Guangdong Inspur Intelligent Computing Technology Co., Ltd, Guangzhou 510623
  • born in 1980. PhD, Senior engineer. Member of CCF. His main research interest includes heterogeneous computing

    born in 1985. PhD, associate researcher. Member of CCF. His main research interest includes heterogeneous computing

    born in 1983. Master, Senior engineer. Member of CCF. His main research interest includes heterogeneous computing

    born in 1994. PhD. His main research interest includes heterogeneous computing

    born in 1990. Master. Her main research interest includes heterogeneous computing

    born in 1963. PhD, professor, PhD supervisor. Member of CCF. His main research interest includes high performance computing

    born in 1975. Master, professor-Senior engineer. Senior member of CCF. His main research interest includes heterogeneous computing

About Author:

born in 1980. PhD, Senior engineer. Member of CCF. His main research interest includes heterogeneous computing

born in 1985. PhD, associate researcher. Member of CCF. His main research interest includes heterogeneous computing

born in 1983. Master, Senior engineer. Member of CCF. His main research interest includes heterogeneous computing

born in 1994. PhD. His main research interest includes heterogeneous computing

born in 1990. Master. Her main research interest includes heterogeneous computing

born in 1963. PhD, professor, PhD supervisor. Member of CCF. His main research interest includes high performance computing

born in 1975. Master, professor-Senior engineer. Senior member of CCF. His main research interest includes heterogeneous computing

Published: 2024-06-01 doi: 10.7544/issn1000-1239.202440055
Outline
收藏切换

The explosive growth of the application of large-scale artificial intelligence models has made it difficult to achieve the scale deployment of applications relying on a single node or a single type of computing architecture. Distributed heterogeneous computing has become the mainstream choice, and inter-node communication has become one of the main bottlenecks in the training or inference process of large models. Currently, there are still some deficiencies in the inter-node communicating solutions dominated by leading chip manufacturers. On the one hand, some architectures choose to use a simple but less scalable point-to-point transmission scheme in order to pursue the ultimate inter-node communication performance. On the other hand, traditional heterogeneous computing engines (such as GPUs) are independent of CPUs in terms of computing resources such as memory and computing cores, but they lack dedicated communicating network devices in terms of communication resources and need to rely entirely or partially on CPUs to handle transmission between heterogeneous computing engines and the shared communicating network device through physical links such as PCIe. The proposed Direct xPU distributed heterogeneous computing architecture in this article enables heterogeneous computing engines to have independent and dedicated devices in both computing and communication resources, achieving zero-copy data and further eliminating the energy consumption and latency associated with cross-chip data transfer during inter-node communication. Evaluations show that Direct xPU achieves communication latency comparable to computing architectures pursuing ultimate inter-node communication performance, with bandwidth close to the physical limit.

inter-node communication  /  FPGA  /  GPU  /  RDMA  /  zero copy
李仁刚, 王彦伟, 郝锐, 肖麟阁, 杨乐, 杨广文, 阚宏伟. Direct xPU:一种新型节点间通信优化的分布式异构计算架构. 计算机研究与发展, 2024 , 61 (6) : 1388 -1400 . DOI: 10.7544/issn1000-1239.202440055
Rengang Li, Yanwei Wang, Rui Hao, Linge Xiao, Le Yang, Guangwen Yang, Hongwei Kan. Direct xPU: A Novel Distributed Heterogeneous Computing Architecture Optimized for Inter-node Communication Optimization[J]. Journal of Computer Research and Development, 2024 , 61 (6) : 1388 -1400 . DOI: 10.7544/issn1000-1239.202440055
Year 2024 volume 61 Issue 6
59
27
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440055
  • Receive Date:2024-01-29
  • Online Date:2026-11-17
  • Published:2024-06-01
Article Data
Affiliations
History
  • Received:2024-01-29
  • Revised:2024-03-27
Affiliations
    1Department of Computer Science and Technology, Tsinghua University, Beijing 100084
    2Inspur (Beijing) Electronic Information Industry Co., Ltd, Beijing 100085
    3Guangdong Inspur Intelligent Computing Technology Co., Ltd, Guangzhou 510623
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440055
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT