收藏切换
Adaptive robust optimization method based on structured pruning and adversarial training
收藏切换
PDF
Ruiqi CAO1, 2, Yulong YANG1, 2, Chenhao LIN1, 2, Zhengyu ZHAO1, 2, Qian LI1, 2, Qian WANG3, Chao SHEN1, 2
Information Countermeasure Technology | 2025, 4(5) : 77 - 88
Less
收藏切换
Information Countermeasure Technology | 2025, 4(5): 77-88
Research Articles
Adaptive robust optimization method based on structured pruning and adversarial training
Full
Ruiqi CAO1, 2, Yulong YANG1, 2, Chenhao LIN1, 2, Zhengyu ZHAO1, 2, Qian LI1, 2, Qian WANG3, Chao SHEN1, 2
Affiliations
  • 1School of Cyber Science and Engineering, Xi'an Jiaotong University, Xi'an 710049, China
  • 2Key Laboratory for Intelligent Networks and Network Security(Xi'an Jiaotong University), Xi'an 710049, China
  • 3School of Cyber Science and Engineering, Wuhan University, Wuhan, 430072, China
doi: 10.12399/j.issn.2097-163x.2025.05.006
Outline
收藏切换

Deep neural networks face storage and computational bottlenecks when deployed on resource-constrained devices. Structured pruning techniques can effectively achieve model compression and acceleration by removing redundant weights,but the adversarial robustness of traditional pruning networks is insufficient,limiting their application in security-sensitive scenarios. To balance the needs for model lightweighting and robustness enhancement,an iterative optimization method combining adversarial training and structured pruning was proposed:during the adversarial training process,the pruning mask is optimized synchronously,and an adaptive training-pruning frequency adjustment mechanism based on the “exploration-exploitation”strategy was innovatively designed to realize the dynamic optimization of hyperparameters. Experimental results on the CIFAR-10 dataset and ResNet-18 model show that,under a sparsity of 0.7,the proposed method increases the model's robust accuracy by 10.32%; in extreme scenarios where sparsity exceeds 0.9,the normal accuracy and robust accuracy are improved by 4.76% and 15.52% respectively; compared with the fixed-frequency strategy,the adaptive mechanism further enhances the normal accuracy by 0.80%~3.59% and the robust accuracy by 1.30%~8.50%,significantly reducing the cost of manual hyperparameter tuning. This research provides an effective technical solution for the secure and efficient deployment of deep neural networks on mobile platform.

structured pruning  /  adversarial training  /  model compression  /  adversarial robustness
Ruiqi CAO, Yulong YANG, Chenhao LIN, Zhengyu ZHAO, Qian LI, Qian WANG, Chao SHEN. Adaptive robust optimization method based on structured pruning and adversarial training[J]. Information Countermeasure Technology, 2025 , 4 (5) : 77 -88 . DOI: 10.12399/j.issn.2097-163x.2025.05.006
Year 2025 volume 4 Issue 5
PDF
82
36
Cite this Article
BibTeX
Article Info
doi: 10.12399/j.issn.2097-163x.2025.05.006
  • Receive Date:2025-07-08
  • Online Date:2026-04-23
Article Data
Affiliations
History
  • Received:2025-07-08
  • Revised:2025-09-01
Affiliations
    1School of Cyber Science and Engineering, Xi'an Jiaotong University, Xi'an 710049, China
    2Key Laboratory for Intelligent Networks and Network Security(Xi'an Jiaotong University), Xi'an 710049, China
    3School of Cyber Science and Engineering, Wuhan University, Wuhan, 430072, China
References
Share
https://castjournals.cast.org.cn/joweb/xxdkjs/EN/10.12399/j.issn.2097-163x.2025.05.006
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT