收藏切换
Adversarial Transfer Attacks on Weak Block of SAM Downstream Models
收藏切换
Yi Ding, Nengjian Lin, Yuntao Jiang, Yuhao Zhong, Mingsheng Cao*
Journal of Computer Research and Development | 2025, 62(10) : 2455 - 2467
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(10): 2455-2467
• Special Issue on Data Security and Privacy Protection in New Distributed Networks and Systems •
Adversarial Transfer Attacks on Weak Block of SAM Downstream Models
Full
Yi Ding, Nengjian Lin, Yuntao Jiang, Yuhao Zhong, Mingsheng Cao*
Affiliations
  • Network and Data Security Key Laboratory of Sichuan Province (University of Electronic Science and Technology of China), Chengdu 610054
  • born in 1985. PhD, professor, PhD supervisor. His main research interests include medical image processing and computer-aided diagnosis

    born in 2001. PhD candidate. His main research interests include artificial intelligence, information security, and image processing

    born in 2002. Master candidate. His main research interests include adversarial example and neural network security

    born in 2000. PhD candidate. His main research interests include artificial intelligence and medical image processing

    born in 1986. PhD, associate professor, master supervisor. His main research interests include artificial intelligence, information security, and privacy protection

About Author:

born in 1985. PhD, professor, PhD supervisor. His main research interests include medical image processing and computer-aided diagnosis

born in 2001. PhD candidate. His main research interests include artificial intelligence, information security, and image processing

born in 2002. Master candidate. His main research interests include adversarial example and neural network security

born in 2000. PhD candidate. His main research interests include artificial intelligence and medical image processing

born in 1986. PhD, associate professor, master supervisor. His main research interests include artificial intelligence, information security, and privacy protection

Published: 2025-10-01 doi: 10.7544/issn1000-1239.202550388
Outline
收藏切换

As a common visual foundation model, the segment anything model (SAM) has been widely applied in various image segmentation tasks, but it exhibits vulnerability in the face of adversarial attacks. A adversarial transfer attack method FSGR (fragile section gradient robustness) has been proposed for vulnerable modules of SAM downstream models, which can effectively generate adversarial samples to attack SAM downstream models without understanding the details of fine-tuning in downstream. The core of FSGR lies in its ability to identify the most vulnerable parts and apply targeted attacks to these weak points. This method designs a strategy based on feature similarity to identify the most vulnerable module in SAM encoder and enhance the attack effectiveness in a targeted manner, and introduces gradient robust loss to eliminate the gradient difference between the target model and downstream task models. FSGR combines vulnerability layer attacks and gradient robust loss to achieve relative performance improvement on multiple datasets. The experimental results show that FSGR significantly reduces model performance in transfer attacks on various fine-tuning models, such as medical segmentation, shadow segmentation, and camouflage segmentation, demonstrating its correctness and practicality. Compared with baseline methods, FSGR not only performs well in attack success rate, but also achieves relative performance improvement by combining vulnerability layer attacks and gradient robust loss.

image segmentation  /  adversarial attack  /  transfer-based attack  /  feature similarity  /  model robustness
丁熠, 林能健, 蒋昀陶, 钟宇浩, 曹明生. 针对SAM下游模型脆弱模块的对抗迁移攻击. 计算机研究与发展, 2025 , 62 (10) : 2455 -2467 . DOI: 10.7544/issn1000-1239.202550388
Yi Ding, Nengjian Lin, Yuntao Jiang, Yuhao Zhong, Mingsheng Cao. Adversarial Transfer Attacks on Weak Block of SAM Downstream Models[J]. Journal of Computer Research and Development, 2025 , 62 (10) : 2455 -2467 . DOI: 10.7544/issn1000-1239.202550388
Year 2025 volume 62 Issue 10
97
40
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550388
  • Receive Date:2025-06-04
  • Online Date:2026-11-10
  • Published:2025-10-01
Article Data
Affiliations
History
  • Received:2025-06-04
  • Revised:2025-07-18
Affiliations
    Network and Data Security Key Laboratory of Sichuan Province (University of Electronic Science and Technology of China), Chengdu 610054
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550388
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT