收藏切换
Research and Optimization of the Winograd-Based Convolutional Algorithm on ShenWei-26010 Many-Core Processor
收藏切换
Zheng Wu, Xu Jin, Hong An
Journal of Computer Research and Development | 2024, 61(4) : 955 - 972
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(4): 955-972
• Software Technology •
Research and Optimization of the Winograd-Based Convolutional Algorithm on ShenWei-26010 Many-Core Processor
Full
Zheng Wu, Xu Jin, Hong An
Affiliations
  • 1School of Computer Science and Technology, University of Science and Technology of China, Hefei 230026
  • born in 1992. PhD. His main research interests include parallel computer system architecture and machine learning

    born in 1992. PhD. His main research interests include machine learning and distributed system

    born in 1963. PhD, professor, PhD supervisor. Her main research interests include chip multiprocessor architecture, parallel computer system architecture, parallel programming environment and tools, and large data parallel storage and processing

About Author:

born in 1992. PhD. His main research interests include parallel computer system architecture and machine learning

born in 1992. PhD. His main research interests include machine learning and distributed system

born in 1963. PhD, professor, PhD supervisor. Her main research interests include chip multiprocessor architecture, parallel computer system architecture, parallel programming environment and tools, and large data parallel storage and processing

Published: 2024-04-01 doi: 10.7544/issn1000-1239.202220787
Outline
收藏切换

As a critical component, convolution is frequently applied in deep learning. The parallel algorithms of convolution have always been a popular research topic in high-performance computing. With the rapid development of Chinese homegrown ShenWei-26010 many-core processor in artificial intelligence, there is an urgent demand for high-performance convolutional algorithms on the processor. We propose an efficient convolutional design, that is, the fused Winograd-based convolutional algorithm, towarding ShenWei-26010 architectural characteristics and the computational features of Winograd-based convolution. Unlike the traditional Winograd-based convolutional algorithm that depends on the official GEMM (general matrix multiplication) library interface, the proposed algorithm owns the customized matrix multiplication implementation. The feature makes the execution process of the proposed algorithm visible, which can better adapt to common convolutions in reality. The proposed algorithm is composed of four parts: input Winograd transformation, filter Winograd transformation, core operation, and output Winograd inverse transformation. The four parts are fused together instead of executing each part separately. The core operation can gain the required transformed data in real time. Subsequently, the computational results are transformed inversely to the final output immediately. The fused execution improves the data locality of the proposed algorithm to reduce the memory access overhead significantly. Moreover, We design other optimization methods to enhance the performance of the proposed algorithm, such as merged Winograd-transformed mode, DMA (direct memory access) double buffering, the enhanced usage of on-chip storage, the elastic processing of output data tiles, and instruction reordering. The experiments show the performance of the proposed algorithm is 7.8 times that of the traditional Winograd-based convolutional algorithm on VGG network model. Moreover, we extract the common convolution from multiple typical convolutional neural networks to measure the hardware efficiency. The results show the proposed algorithm can significantly overperform the traditional Winograd-based convolutional algorithm for all the convolution cases. The best performance of the proposed algorithm is 116.21% of the theoretical peak performance of ShenWei-26010 processor, and the average one can reach 93.14%.

deep learning  /  Winograd-based convolution  /  high-performance computing  /  parallel algorithm  /  ShenWei processor
武铮, 金旭, 安虹. 申威26010众核处理器上Winograd卷积算法的研究与优化. 计算机研究与发展, 2024 , 61 (4) : 955 -972 . DOI: 10.7544/issn1000-1239.202220787
Zheng Wu, Xu Jin, Hong An. Research and Optimization of the Winograd-Based Convolutional Algorithm on ShenWei-26010 Many-Core Processor[J]. Journal of Computer Research and Development, 2024 , 61 (4) : 955 -972 . DOI: 10.7544/issn1000-1239.202220787
Year 2024 volume 61 Issue 4
69
33
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202220787
  • Receive Date:2022-09-01
  • Online Date:2026-11-17
  • Published:2024-04-01
Article Data
Affiliations
History
  • Received:2022-09-01
  • Revised:2023-05-22
Affiliations
    1School of Computer Science and Technology, University of Science and Technology of China, Hefei 230026
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202220787
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT