收藏切换
Efficient Sparse Matrix Multiplication Kernel for Dataflow Architecture
收藏切换
Wenbin Jiang, Baoyang Liu, Yukang Dong, Xinhai Shen
Journal of Computer Research and Development | 2026, 63(11) : 2807 - 2821
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(11): 2807-2821
• Computer Architecture •
Efficient Sparse Matrix Multiplication Kernel for Dataflow Architecture
Full
Wenbin Jiang, Baoyang Liu, Yukang Dong, Xinhai Shen
Affiliations
  • National Engineering Research Center for Big Data Technology and System (Huazhong University of Science and Technology), Wuhan 430074
  • Services Computing Technology and System Lab (Huazhong University of Science and Technology), Ministry of Education, Wuhan 430074
  • Cluster and Grid Computing Lab (Huazhong University of Science and Technology), Wuhan 430074
  • School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074
  • born in 1975. Professor. His main research interests include deep learning systems, parallel and distributed computing, and graph computing

    born in 2000. Master. His main research interest includes high performance computing

    born in 1995. PhD candidate. His main research interests include high performance computing and large language model inference optimization

    born in 2001. PhD candidate. His main research interest includes large language model inference acceleration

About Author:

born in 1975. Professor. His main research interests include deep learning systems, parallel and distributed computing, and graph computing

born in 2000. Master. His main research interest includes high performance computing

born in 1995. PhD candidate. His main research interests include high performance computing and large language model inference optimization

born in 2001. PhD candidate. His main research interest includes large language model inference acceleration

Published: 2026-11-01 doi: 10.7544/issn1000-1239.202550678
Outline
收藏切换

In recent years, sparse-dense matrix multiplication (SpMM) has become a core operator in various fields such as scientific computing, graph processing, and deep learning, while also being a bottleneck limiting system performance. However, existing GPU implementations of SpMM generally suffer from low energy efficiency and resource utilization. Specialized accelerators demonstrate excellent energy efficiency in regular computations, while lack efficient support for irregular sparse matrix operations. To this end, we propose an efficient sparse matrix processing kernel tailored for dataflow architecture, DFU-SpMM, targeting the high-throughput dataflow unit (DFU). Firstly, a hierarchical sparse matrix processing method is proposed to ensure that the sparse blocks have a regular calculation pattern to reduce the number of dataflow graph retransmissions on the SpMM kernel on DFU. Meanwhile, for sparse blocks with different characteristics, different strategies are used to process them. Secondly, an adaptive assembly code generation method for dataflow graph optimization is proposed for optimizing dataflow graph. By leveraging the inspector-executor framework to overcome the current limitations of DFU in generating SpMM kernels, the dataflow graph is further optimized during code generation with respect to task allocation and register reuse. Experiments on representative datasets demonstrate that, compared with state-of-the-art implementations DTC-SpMM and HP-SpMM on an RTX 4090 GPU, the proposed method achieves an average 1.09 times and 1.23 times higher energy efficiency, along with 1.71 times and 1.10 times better computational resource utilization, respectively. Compared with the baseline SpMM kernel on the DFU accelerator without data reorganization, the optimized kernel with data reorganization achieves 1.41 times speedup and 1.51 times energy efficiency improvement.

deep learning  /  high-performance computing  /  sparse computation acceleration  /  dataflow graph  /  data reorganization
蒋文斌, 刘宝阳, 董雨康, 沈欣海. 面向数据流架构的稀疏矩阵高效处理内核. 计算机研究与发展, 2026 , 63 (11) : 2807 -2821 . DOI: 10.7544/issn1000-1239.202550678
Wenbin Jiang, Baoyang Liu, Yukang Dong, Xinhai Shen. Efficient Sparse Matrix Multiplication Kernel for Dataflow Architecture[J]. Journal of Computer Research and Development, 2026 , 63 (11) : 2807 -2821 . DOI: 10.7544/issn1000-1239.202550678
Year 2026 volume 63 Issue 11
94
42
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550678
  • Receive Date:2025-09-21
  • Online Date:2026-11-17
  • Published:2026-11-01
Article Data
Affiliations
History
  • Received:2025-09-21
  • Revised:2026-06-09
  • Accepted:2026-06-22
Affiliations
    National Engineering Research Center for Big Data Technology and System (Huazhong University of Science and Technology), Wuhan 430074
    Services Computing Technology and System Lab (Huazhong University of Science and Technology), Ministry of Education, Wuhan 430074
    Cluster and Grid Computing Lab (Huazhong University of Science and Technology), Wuhan 430074
    School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550678
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT