收藏切换
Integer Quantization Method Based on Low Bit Sharing
收藏切换
Linhao Li1, Xuandi Zeng1, Yibin Tang2, 3, Bosheng Liu1, *, Jigang Wu1
Journal of Computer Research and Development | 2026, 63(6) : 1574 - 1583
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(6): 1574-1583
• Artificial Intelligence •
Integer Quantization Method Based on Low Bit Sharing
Full
Linhao Li1, Xuandi Zeng1, Yibin Tang2, 3, Bosheng Liu1, *, Jigang Wu1
Affiliations
  • 1School of Computer Science and Technology, Guangdong University of Technology, Guangzhou 510006
  • 2Wuhan Digital Engineering Institute, Wuhan 430074
  • 3Innovation Center for GPU and Intelligent Computing System Technology, Wuhan 430074
  • born in 2001. Master candidate. His main research interest includes hardware-software co-design based on deep learning

    born in 2003. Undergraduate. His main research interest includes hardware-software co-design based on deep learning

    born in 1991. PhD, professor. His main research interests include the hardware-software co-design based on deep learning and computer architecture

    born in 1988. PhD, associate professor. His main research interests include hardware-software co-optimization for LLMs and computer architecture

    born in 1963. PhD, PhD supervisor. His main research interests include AI, high-performance computing, and data science. ()

About Author:

born in 2001. Master candidate. His main research interest includes hardware-software co-design based on deep learning

born in 2003. Undergraduate. His main research interest includes hardware-software co-design based on deep learning

born in 1991. PhD, professor. His main research interests include the hardware-software co-design based on deep learning and computer architecture

born in 1988. PhD, associate professor. His main research interests include hardware-software co-optimization for LLMs and computer architecture

born in 1963. PhD, PhD supervisor. His main research interests include AI, high-performance computing, and data science. ()

Published: 2026-06-01 doi: 10.7544/issn1000-1239.202550648
Outline
收藏切换

With the rapid advancement of artificial intelligence technologies, large language models (LLMs) have emerged as foundational components in modern intelligent systems. However, the ever-increasing model size—ranging from billions to hundreds of billions of parameters—poses significant challenges in terms of memory footprint and computational overhead, particularly on latency-sensitive and resource-constrained platforms. While low-bit integer quantization (e.g., INT8) has demonstrated effectiveness in reducing memory consumption and improving inference efficiency, it suffers from notable quantization limitations when applied to large-scale models, including quantization-induced accuracy degradation and inefficient storage utilization. To address these issues, we propose a numerical quantization framework, termed low bit sharing (LBS). Built upon conventional integer quantization, LBS provides a structured high-low bit decomposition scheme that preserves only the most significant bits for each parameter and shares the less significant bits within a tensor group. The shared solution can reduce storage requirements while upholding the numerical representational capability. Furthermore, to mitigate accuracy degradation caused by the quantization of high-impact weights, we develop a salient value aware quantization strategy. By employing a Top-K selection algorithm, we isolate the most influential weights—typically residing in the tail of the parameter distribution—and assign them dedicated scaling factors. This targeted treatment effectively suppresses error accumulation during quantization and improves robustness in downstream performance. Experimental results across several state-of-the-art LLMs show that LBS achieves substantial storage reduction while preserving high model accuracy, making it a practical and scalable solution for deployment of large-scale models.

low bit sharing (LBS)  /  large language models (LLMs)  /  integer (INT) quantization  /  model accuracy  /  numerical representation
李林浩, 曾宣迪, 唐忆滨, 刘博生, 武继刚. 基于低比特共享的整型量化方法. 计算机研究与发展, 2026 , 63 (6) : 1574 -1583 . DOI: 10.7544/issn1000-1239.202550648
Linhao Li, Xuandi Zeng, Yibin Tang, Bosheng Liu, Jigang Wu. Integer Quantization Method Based on Low Bit Sharing[J]. Journal of Computer Research and Development, 2026 , 63 (6) : 1574 -1583 . DOI: 10.7544/issn1000-1239.202550648
Year 2026 volume 63 Issue 6
69
32
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550648
  • Receive Date:2025-09-02
  • Online Date:2026-11-17
  • Published:2026-06-01
Article Data
Affiliations
History
  • Received:2025-09-02
  • Revised:2026-01-12
  • Accepted:2026-01-29
Affiliations
    1School of Computer Science and Technology, Guangdong University of Technology, Guangzhou 510006
    2Wuhan Digital Engineering Institute, Wuhan 430074
    3Innovation Center for GPU and Intelligent Computing System Technology, Wuhan 430074
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550648
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT