收藏切换
Efficient Optimization of Erasure Coding for Storage Library
收藏切换
Wenbing Xie, Ruixue Guan*, Yiming Zhang, Jiamei Li, Jun Wang
Journal of Computer Research and Development | 2025, 62(5) : 1123 - 1135
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(5): 1123-1135
• Computer Achitecture •
Efficient Optimization of Erasure Coding for Storage Library
Full
Wenbing Xie, Ruixue Guan*, Yiming Zhang, Jiamei Li, Jun Wang
Affiliations
  • Wuxi Institute of Advanced Technology, Wuxi, Jiangsu 214126
  • born in 1989. PhD candidate. His main research interests include binary translation, runtime libraries optimization, program analysis, and compiler optimization

    born in 1993. Master. Her main research interests include binary instrumentation and runtime libraries optimization

    born in 1993. Master. Her main research interests include binary instrumentation, debug tools, runtime libraries optimization

    born in 1996. Master. Her main research interests include program analysis and runtime libraries optimization

    born in 1981. Master. His main research interests include program analysis, and autonomous and controllable basic software ecology

About Author:

born in 1989. PhD candidate. His main research interests include binary translation, runtime libraries optimization, program analysis, and compiler optimization

born in 1993. Master. Her main research interests include binary instrumentation and runtime libraries optimization

born in 1993. Master. Her main research interests include binary instrumentation, debug tools, runtime libraries optimization

born in 1996. Master. Her main research interests include program analysis and runtime libraries optimization

born in 1981. Master. His main research interests include program analysis, and autonomous and controllable basic software ecology

Published: 2025-05-01 doi: 10.7544/issn1000-1239.202440091
Outline
收藏切换

In the information stage, the importance of data storage lies in ensuring the reliability, consistency, security, and real-time accessibility of information. Erasure codes (EC) play a crucial role in data storage systems due to their ability to minimize storage overhead and handle multiple component failures. However, the process of encoding and decoding EC involves intensive computation, impacting storage system efficiency. This paper focuses on optimizing EC, with a special emphasis on the Galois field (GF) multiplication within multi-layer loops, a time-consuming aspect of EC. We first evaluate the pros and cons of three methods for GF multiplication calculation: the log table searching method, the complete multiplication table searching method, and the shift decomposition method. Subsequently, a 4 b splitting (SP) method is proposed to reduce memory access overhead during table searching in GF(28). We delve into the SP’s analysis and leverage the 64 b modern processor architecture and vector instruction set characteristics to introduce data-level parallelism in multi-layer loops. This involves amplifying data access granularity and implementing single instruction multiple data (SIMD) vectorization. Based on the open-source Intel storage acceleration library (ISA-L), all optimization methods are implemented and tested on Sunway processor and x86 processor. The experimental results show the effectiveness of proposed optimization in improving EC performance across different data scalability scenarios. When compared with the original ISA-L, our optimizations exhibit an average performance speedup of 3.28× on Sunway, 2.36× on x86.

erasure codes  /  Galois field multiplication  /  4b splitting method  /  data access granularity  /  SIMD vectorization  /  data lookup table
谢汶兵, 关睿雪, 张艺鸣, 李佳梅, 王俊. 一种面向纠删码的存储库优化方法. 计算机研究与发展, 2025 , 62 (5) : 1123 -1135 . DOI: 10.7544/issn1000-1239.202440091
Wenbing Xie, Ruixue Guan, Yiming Zhang, Jiamei Li, Jun Wang. Efficient Optimization of Erasure Coding for Storage Library[J]. Journal of Computer Research and Development, 2025 , 62 (5) : 1123 -1135 . DOI: 10.7544/issn1000-1239.202440091
Year 2025 volume 62 Issue 5
155
77
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440091
  • Receive Date:2024-02-03
  • Online Date:2026-11-10
  • Published:2025-05-01
Article Data
Affiliations
History
  • Received:2024-02-03
  • Revised:2024-10-11
  • Accepted:2024-10-15
Affiliations
    Wuxi Institute of Advanced Technology, Wuxi, Jiangsu 214126
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440091
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT