收藏切换
History, Present, and Future of Low-Bit Quantization for Large Language Model: A Case Study on Complex-Domain Quantization
收藏切换
Peizhuang Cong1, Feiyu Wang1, Guo’an Wang1, Yanshu Wang1, Ce Zheng2, Tong Yang1, *
Journal of Computer Research and Development | 2026, 63(2) : 276 - 293
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(2): 276-293
• Research Highlights •
History, Present, and Future of Low-Bit Quantization for Large Language Model: A Case Study on Complex-Domain Quantization
Full
Peizhuang Cong1, Feiyu Wang1, Guo’an Wang1, Yanshu Wang1, Ce Zheng2, Tong Yang1, *
Affiliations
  • 1State Key Laboratory of Multimedia Information Processing (Peking University), Beijing 100871
  • 2School of Cyber Science and Technology, Beihang University, Beijing 100191
  • born in 1994. PhD, postdoctoral researcher. Member of CCF. His main research interests include LLM quantization and inference optimization, and new architecture of networking

    born in 1999. PhD candidate. His main research interests include LLM quantization technology and inference acceleration

    born in 2004. Master candidate. His main research interests include edge intelligence and model compression algorithms

    born in 1994. PhD, postdoctoral researcher. His main research interests include high-performance network measurement algorithms, distributed machine learning systems, and LLM quantization and inference acceleration

    born in 1994. PhD candidate. Her main research interests include network measurement algorithms and LLMs

    born in 1982. PhD, associate professor, PhD supervisor. His main research interests include LLM, network measurement, and new data structures

About Author:

born in 1994. PhD, postdoctoral researcher. Member of CCF. His main research interests include LLM quantization and inference optimization, and new architecture of networking

born in 1999. PhD candidate. His main research interests include LLM quantization technology and inference acceleration

born in 2004. Master candidate. His main research interests include edge intelligence and model compression algorithms

born in 1994. PhD, postdoctoral researcher. His main research interests include high-performance network measurement algorithms, distributed machine learning systems, and LLM quantization and inference acceleration

born in 1994. PhD candidate. Her main research interests include network measurement algorithms and LLMs

born in 1982. PhD, associate professor, PhD supervisor. His main research interests include LLM, network measurement, and new data structures

Published: 2026-02-01 doi: 10.7544/issn1000-1239.202550788
Outline
收藏切换

With the exponential growth in the parameter scale of large language models (LLMs), model deployment and inference face severe challenges in terms of memory and computational resources. Quantization, as a core compression technique, significantly reduces storage requirements and computational overhead by lowering the numerical precision of weights and activations. We first review the development of quantization techniques, from classic Int8/4 methods to cutting-edge extreme-low bit algorithms. Then we summarize the technical characteristics and performance evolution of typical methods, identifying a key challenge: traditional real-domain quantization is limited by discretization errors at extreme-low bitrates, making it difficult to break its performance ceiling. To address this limitation, we systematically review the complex-domain quantization series of work. This series introduces a quantization paradigm based on the complex domain, which significantly expands the model’s expressive space by utilizing amplitude and phase as two degrees of freedom in the parameter representation. Moreover, drawing on the classic paradigm in signal processing where stable representations are achieved by applying the Fourier transform and low-pass filtering to time-domain signals, we further propose a technical path that proceeds from real-valued models through complex-domain transformation and complex-domain quantization, ultimately achieving multiplier-free stable inference. Experimental results demonstrate that iFairy outperforms existing extreme-low-bit methods on multiple benchmark datasets and effectively breaks the real-domain performance ceiling. This showcases the potential value of complex-domain quantization in achieving both efficient modeling and performance preservation. Through a systematic analysis of quantization’s evolution and the case study on complex-domain quantization, we reveal development patterns and future trends, providing a reference for the theoretical research and engineering implementation of efficient LLMs.

large language model  /  model quantization  /  low-bit quantization  /  model compression  /  complex valued model
丛培壮, 王飞宇, 王国安, 王砚舒, 郑策, 杨仝. 大语言模型低比特量化的历史、现状和未来:以复域量化为例. 计算机研究与发展, 2026 , 63 (2) : 276 -293 . DOI: 10.7544/issn1000-1239.202550788
Peizhuang Cong, Feiyu Wang, Guo’an Wang, Yanshu Wang, Ce Zheng, Tong Yang. History, Present, and Future of Low-Bit Quantization for Large Language Model: A Case Study on Complex-Domain Quantization[J]. Journal of Computer Research and Development, 2026 , 63 (2) : 276 -293 . DOI: 10.7544/issn1000-1239.202550788
Year 2026 volume 63 Issue 2
181
90
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550788
  • Receive Date:2025-10-31
  • Online Date:2026-11-06
  • Published:2026-02-01
Article Data
Affiliations
History
  • Received:2025-10-31
  • Revised:2025-12-18
Affiliations
    1State Key Laboratory of Multimedia Information Processing (Peking University), Beijing 100871
    2School of Cyber Science and Technology, Beihang University, Beijing 100191
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550788
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT