收藏切换
Survey of Textual Backdoor Attack and Defense
收藏切换
Mingyu Zheng1, 2, Zheng Lin1, 2, *, Zhengxiao Liu1, Peng Fu1, Weiping Wang1
Journal of Computer Research and Development | 2024, 61(1) : 221 - 242
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(1): 221-242
• Network and Information Security •
Survey of Textual Backdoor Attack and Defense
Full
Mingyu Zheng1, 2, Zheng Lin1, 2, *, Zhengxiao Liu1, Peng Fu1, Weiping Wang1
Affiliations
  • 1Institute of Information Engineering, Chinese Academy of Sciences, Beijing 100093
  • 2School of Cyber Security, University of Chinese Academy of Sciences, Beijing 100049
  • born in 1998. Master candidate. His main research interest includes natural language processing

    born in 1984. PhD, professor, PhD supervisor. Member of CCF. Her main research interests include sentiment analysis, machine reading comprehension, and text generation

    born in 1997. Master. His main research interests include natural language processing, adversarial attack, and backdoor attack

    born in 1987. PhD, associate professor, master supervisor. Member of CCF. His main research interests include text generation, question answering, and sentiment analysis

    born in 1975. PhD, professor, PhD supervisor. His main research interests include big data, artificial intelligence, and data security

About Author:

born in 1998. Master candidate. His main research interest includes natural language processing

born in 1984. PhD, professor, PhD supervisor. Member of CCF. Her main research interests include sentiment analysis, machine reading comprehension, and text generation

born in 1997. Master. His main research interests include natural language processing, adversarial attack, and backdoor attack

born in 1987. PhD, associate professor, master supervisor. Member of CCF. His main research interests include text generation, question answering, and sentiment analysis

born in 1975. PhD, professor, PhD supervisor. His main research interests include big data, artificial intelligence, and data security

Published: 2024-01-02 doi: 10.7544/issn1000-1239.202220340
Outline
收藏切换

In the deep learning community, lots of efforts have been made to enhance the robustness and the reliability of deep neural networks (DNNs). Previous research mainly analyzed the fragility of DNN from the perspective of adversarial attack, and researchers designed numerous adversarial attack and defense methods. However, with the wide application of pre-trained models (PTMs), a new security threat against DNN especially PTM, called backdoor attack is emerging. Backdoor attack aims at injecting hidden backdoors into DNN, such that the backdoored model behaves properly on normal inputs but produces attacker-specified malicious outputs on the poisoned inputs embedded with special triggers. Backdoor attack poses a severe threat against DNN based systems like spam filter or hate speech detector. Compared with the textual adversarial attack and defense which has been widely studied, textual backdoor attack and defense has not been thoroughly investigated and requires a systematic review. In this paper, we present a comprehensive survey of backdoor attack and defense methods in the text domain. Specifically, we first summarize and categorize the textual backdoor attack and defense methods from different perspectives, then we introduce typical work and analyze their pros and cons. We also enumerate widely adopted benchmark datasets and evaluation metrics in the current literatures. Moreover, we respectively compare the backdoor attack with two relevant threats (i.e., adversarial attack and data poisoning). Finally, we discuss existing challenges of backdoor attack and defense in the text domain and present several promising future directions in this emerging and rapidly growing research area.

backdoor attack  /  backdoor defense  /  natural language processing  /  pre-trained models  /  AI security
郑明钰, 林政, 刘正宵, 付鹏, 王伟平. 文本后门攻击与防御综述. 计算机研究与发展, 2024 , 61 (1) : 221 -242 . DOI: 10.7544/issn1000-1239.202220340
Mingyu Zheng, Zheng Lin, Zhengxiao Liu, Peng Fu, Weiping Wang. Survey of Textual Backdoor Attack and Defense[J]. Journal of Computer Research and Development, 2024 , 61 (1) : 221 -242 . DOI: 10.7544/issn1000-1239.202220340
Year 2024 volume 61 Issue 1
66
31
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202220340
  • Receive Date:2022-04-25
  • Online Date:2026-11-17
  • Published:2024-01-02
Article Data
Affiliations
History
  • Received:2022-04-25
  • Revised:2023-02-06
Affiliations
    1Institute of Information Engineering, Chinese Academy of Sciences, Beijing 100093
    2School of Cyber Security, University of Chinese Academy of Sciences, Beijing 100049
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202220340
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT