收藏切换
Three-Stage Few-Shot Object Detection via Cross-Module Knowledge Distillation
收藏切换
Shuangcheng Wang, Songhao Zhu*
Journal of Computer Research and Development | 2026, 63(1) : 199 - 213
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(1): 199-213
• Artificial Intelligence •
Three-Stage Few-Shot Object Detection via Cross-Module Knowledge Distillation
Full
Shuangcheng Wang, Songhao Zhu*
Affiliations
  • College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023
  • born in 2002. Master candidate. His main research interests include pattern recognition and machine learning

    born in 1973. PhD. His main research interests include image processing, pattern recognition, and artificial intelligence

About Author:

born in 2002. Master candidate. His main research interests include pattern recognition and machine learning

born in 1973. PhD. His main research interests include image processing, pattern recognition, and artificial intelligence

Published: 2026-01-01 doi: 10.7544/issn1000-1239.202550009
Outline
收藏切换

Few-shot learning is the mainstream method for few-shot object detection, but it has serious shortcomings. 1) The extreme lack of new class samples leads to biased distribution of new class features; 2) Due to the robustness assumption during the fine-tuning process are not necessarily applicable to new class samples, the feature extraction network is unable to extract unbiased new class sample features. To deal with the above two issues, three-stage fine-tuning few-shot object detection method based on cross-module knowledge distillation is proposed. Firstly, the feature distribution calibration strategy is designed to calibrate the feature distribution of new class during the two-step fine-tuning process. Secondly, the proposed first bias reduction strategy, effectively alleviates the bias estimation problem of weight parameters in the linear probing (the first stage of the fine-tuning process), and the proposed inverse first bias reduction effectively alleviates the over-fitting problem of feature extraction network during overall fine-tuning (the second stage of the fine-tuning process). Finally, the proposed cross-module knowledge distillation strategy is utilized to guide the shallow modules of the model to learn deep features to capture more discriminative new class features. A large number of experimental results show that the proposed three-stage fine-tuning few-shot object detection method effectively improves the accuracy and robustness of few-shot object detection.

few-shot object detection  /  three-stage fine-tuning  /  first bias reduction  /  inverse first bias reduction  /  cross-module knowledge distillation
王双丞, 朱松豪. 基于跨模块知识蒸馏的3阶段少样本目标检测. 计算机研究与发展, 2026 , 63 (1) : 199 -213 . DOI: 10.7544/issn1000-1239.202550009
Shuangcheng Wang, Songhao Zhu. Three-Stage Few-Shot Object Detection via Cross-Module Knowledge Distillation[J]. Journal of Computer Research and Development, 2026 , 63 (1) : 199 -213 . DOI: 10.7544/issn1000-1239.202550009
Year 2026 volume 63 Issue 1
208
91
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550009
  • Receive Date:2025-01-10
  • Online Date:2026-11-06
  • Published:2026-01-01
Article Data
Affiliations
History
  • Received:2025-01-10
  • Revised:2025-05-26
  • Accepted:2025-05-28
Affiliations
    College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550009
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT