收藏切换
Knowledge Distillation Based Algorithm for Low Quality Face Image Recognition
收藏切换
PDF
Aishanjiang YINGTEZHAER, YIlIHAMU·Yaermaimaiti*
Science Technology and Engineering | 2025, 25(2) : 695 - 703
Less
收藏切换
Science Technology and Engineering | 2025, 25(2): 695-703
Papers·Automation and Computational Technology
Knowledge Distillation Based Algorithm for Low Quality Face Image Recognition
Full
Aishanjiang YINGTEZHAER, YIlIHAMU·Yaermaimaiti*
Affiliations
  • School of Electrical Engineering, Xinjiang University, Urumqi 830017, China
Published: 2025-01-18 doi: 10.12404/j.issn.1671-1815.2401917
Outline
收藏切换

Aiming at the shortcomings of low-quality face recognition algorithms based on unified feature space, such as poor robustness to low-quality faces and limited feature representation capability, a low-quality face image recognition algorithm based on knowledge distillation was proposed. First, the ResNeXt network was used as the backbone feature extraction network, and the two-channel attention module was introduced to construct a teacher-student knowledge distillation framework with an attention mechanism. Secondly, the output features of the teacher network were adopted as labeled knowledge, and the effective recognition features were passed to the student network. And the attention graph features were adopted as the intermediate layer knowledge to solve the lack of single knowledge information in the output layer, and the feature knowledge was enriched by combining two kinds of knowledge distillation to ensure the diversity of knowledge information in the teacher network model. Then, the weighted average of labeled knowledge distillation loss, attention graph distillation loss, and recognition loss were fused as the total network loss function to ensure that the student network model has a better learning ability. Finally, tested under different quality images in AgeDB-30 and CPLFW test sets, the results of the ablation experiments show that compared to the generic face recognition model without distillation, the model with two types of knowledge distillation gains 2.25%, 11.33%, 24.64% and 2.8%, 10.58%, 27.85% improvement in recognition accuracy, respectively. Comparative experiments show that the algorithm proposed in this paper also obtains different degrees of improvement in accuracy compared to other mainstream algorithms.

low quality face images  /  knowledge distillation  /  attention mechanism  /  Resnext
Aishanjiang YINGTEZHAER, YIlIHAMU·Yaermaimaiti. Knowledge Distillation Based Algorithm for Low Quality Face Image Recognition[J]. Science Technology and Engineering, 2025 , 25 (2) : 695 -703 . DOI: 10.12404/j.issn.1671-1815.2401917
Year 2025 volume 25 Issue 2
PDF
258
98
Cite this Article
BibTeX
Article Info
doi: 10.12404/j.issn.1671-1815.2401917
  • Receive Date:2024-03-18
  • Online Date:2025-12-05
  • Published:2025-01-18
Article Data
Affiliations
History
  • Received:2024-03-18
  • Revised:2024-10-31
Funding
Affiliations
    School of Electrical Engineering, Xinjiang University, Urumqi 830017, China
References
Share
https://castjournals.cast.org.cn/joweb/kxjsygc/EN/10.12404/j.issn.1671-1815.2401917
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT