收藏切换
Porting and Parallel Optimization of Common Operators Based on Heterogeneous Programming Models
收藏切换
Zhaojia Ma1, 2, En Shao1, 2, 3, *, Zhanyuan Di1, 2, Lixian Ma1, 2
Journal of Computer Research and Development | 2025, 62(4) : 1017 - 1032
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(4): 1017-1032
• Software Technology •
Porting and Parallel Optimization of Common Operators Based on Heterogeneous Programming Models
Full
Zhaojia Ma1, 2, En Shao1, 2, 3, *, Zhanyuan Di1, 2, Lixian Ma1, 2
Affiliations
  • 1State Key Lab of Processors (Institute of Computing Technology, Chinese Academy of Sciences), Beijing 100190
  • 2University of Chinese Academy of Sciences, Beijing 100049
  • 3Nanjing Institute of InforSuperBahn, Nanjing 211100
  • born in 2000. Master candidate. His main research interest includes high-performance computing

    born in 1988. PhD, senior engineer, master supervisor. Senior member of CCF. His main research interests include computer interconnect network, SYCL, and high-performance computing and systems software

    born in 1999. PhD candidate. His main research interests include parallel computing, compilation optimization, and code generation

    born in 1993. PhD candidate, engineer. His main research interests include high performance computing and machine learning

About Author:

born in 2000. Master candidate. His main research interest includes high-performance computing

born in 1988. PhD, senior engineer, master supervisor. Senior member of CCF. His main research interests include computer interconnect network, SYCL, and high-performance computing and systems software

born in 1999. PhD candidate. His main research interests include parallel computing, compilation optimization, and code generation

born in 1993. PhD candidate, engineer. His main research interests include high performance computing and machine learning

Published: 2025-04-01 doi: 10.7544/issn1000-1239.202330869
Outline
收藏切换

As the fundamental computing component in constructing large-scale supercomputing systems, GPUs are undergoing architectural diversity and heterogeneity. GPU accelerators from various chip manufacturers exhibit significant variations in their architectural designs. Accelerator diversity and programming model diversity are important technical trends for building large-scale supercomputing systems. Diverse accelerators require developers to provide high-performance software for multiple hardware platforms, resulting in software duplication. To reduce the cost of duplication, the unified programming model SYCL (system-wide compute language) adapts to multiple hardware platforms, but SYCL’s performance on different hardware is not as good as the native programming model of the platform, and SYCL’s performance needs to be further optimized. In order to be able to apply the mature and complete CUDA (compute unified device architecture) programming ideas and high-performance programs to SYCL, it is necessary to discuss the performance of high-performance CUDA programs ported to SYCL on multiple platforms and the ideas for further optimization. Based on software-hardware co-design, we propose paraTRANS: a common operator optimization system for the code migration process of cross-heterogeneous programming model SYCL, and give the optimization methods for the migrated SYCL GEMM (general matrix multiplication) in different scenarios. We evaluate the performance of SYCL GEMM optimized by paraTRANS, which can achieve 96.95% of CUDA’s FLOPS on the original NVIDIA RTX 3090, and 100.47% of CUDA’s hardware peak performance percentage on AMD MI100, both close to the level before migration. This paper provides ideas for porting high-performance CUDA code to SYCL and further optimization.

SYCL  /  cross heterogeneous architecture  /  code migration  /  GEMM  /  parallel optimization
马兆佳, 邵恩, 狄战元, 马立贤. 基于异构编程模型的共性算子移植与并行优化. 计算机研究与发展, 2025 , 62 (4) : 1017 -1032 . DOI: 10.7544/issn1000-1239.202330869
Zhaojia Ma, En Shao, Zhanyuan Di, Lixian Ma. Porting and Parallel Optimization of Common Operators Based on Heterogeneous Programming Models[J]. Journal of Computer Research and Development, 2025 , 62 (4) : 1017 -1032 . DOI: 10.7544/issn1000-1239.202330869
Year 2025 volume 62 Issue 4
106
52
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202330869
  • Receive Date:2023-10-31
  • Online Date:2026-11-10
  • Published:2025-04-01
Article Data
Affiliations
History
  • Received:2023-10-31
  • Revised:2024-07-02
  • Accepted:2024-08-09
Affiliations
    1State Key Lab of Processors (Institute of Computing Technology, Chinese Academy of Sciences), Beijing 100190
    2University of Chinese Academy of Sciences, Beijing 100049
    3Nanjing Institute of InforSuperBahn, Nanjing 211100
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330869
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT