收藏切换
Survey of Multimodal Vision-Language Representation Learning Models and Their Adversarial Examples Attack and Defense Techniques
收藏切换
Cheng Zeng1, Yunjie Ge2, Lingchen Zhao1, Qian Wang1, *
Journal of Computer Research and Development | 2025, 62(9) : 2208 - 2232
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(9): 2208-2232
• Special Issue on Advances and Applications of Data-Centric AI •
Survey of Multimodal Vision-Language Representation Learning Models and Their Adversarial Examples Attack and Defense Techniques
Full
Cheng Zeng1, Yunjie Ge2, Lingchen Zhao1, Qian Wang1, *
Affiliations
  • 1School of Cyber Science and Engineering, Wuhan University, Wuhan 430072
  • 2Institute for Math & AI (Wuhan University), Wuhan 430072
  • born in 2002. PhD candidate. His main research interests include artificial intelligence interpretability and artificial intelligence security

    born in 1997. PhD. Her main research interests include artificial intelligence security and model fairness

    born in 1994. PhD, associate professor. His main research interests include artificial intelligence security and privacy computing

    born in 1980. PhD, professor. His main research interests include artificial intelligence security, data storage, security of outsourced query and computation, privacy protection, wireless system security, and applied cryptography

About Author:

born in 2002. PhD candidate. His main research interests include artificial intelligence interpretability and artificial intelligence security

born in 1997. PhD. Her main research interests include artificial intelligence security and model fairness

born in 1994. PhD, associate professor. His main research interests include artificial intelligence security and privacy computing

born in 1980. PhD, professor. His main research interests include artificial intelligence security, data storage, security of outsourced query and computation, privacy protection, wireless system security, and applied cryptography

Published: 2025-09-01 doi: 10.7544/issn1000-1239.202550410
Outline
收藏切换

With the rapid development of computer vision, natural language processing, and deep learning technologies, multimodal vision-language representation learning models have demonstrated outstanding performance in tasks such as image captioning, text-to-image generation, and visual question answering. Such models have consequently become a focus of research in both academia and industry. However, the multimodal nature and complexity of these models provide attackers with more diverse attack vectors. Attackers can craft adversarial examples to mislead these models into outputting incorrect, harmful, or false content, posing an increasingly serious security threat to such models. This paper systematically reviews the current state of research on multimodal vision-language models. It also categorizes and summarizes the adversarial examples-based attack methods that have emerged in recent years against these models, as well as their defense strategies. Furthermore, it provides a detailed overview of the fundamental principles, implementation approaches, and conclusions of relevant studies. On this basis, this paper discusses the current state and future directions of security research in multimodal vision-language representation learning. Finally, the paper envisions the future prospects of applying vision-language representation learning technology in combination with interpretability techniques.

representation learning  /  vision-language learning  /  adversarial attack  /  adversarial defense  /  cyber security
曾诚, 葛云洁, 赵令辰, 王骞. 多模态视觉语言表征学习模型及其对抗样本攻防技术综述. 计算机研究与发展, 2025 , 62 (9) : 2208 -2232 . DOI: 10.7544/issn1000-1239.202550410
Cheng Zeng, Yunjie Ge, Lingchen Zhao, Qian Wang. Survey of Multimodal Vision-Language Representation Learning Models and Their Adversarial Examples Attack and Defense Techniques[J]. Journal of Computer Research and Development, 2025 , 62 (9) : 2208 -2232 . DOI: 10.7544/issn1000-1239.202550410
Year 2025 volume 62 Issue 9
167
67
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550410
  • Receive Date:2025-06-06
  • Online Date:2026-11-10
  • Published:2025-09-01
Article Data
Affiliations
History
  • Received:2025-06-06
  • Revised:2025-07-09
Affiliations
    1School of Cyber Science and Engineering, Wuhan University, Wuhan 430072
    2Institute for Math & AI (Wuhan University), Wuhan 430072
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550410
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT