收藏切换
JADE-DB:A Universal Testing Benchmark for Large Language Model Safety Based on Targeted Mutation
收藏切换
Mi Zhang, Xudong Pan, Min Yang*
Journal of Computer Research and Development | 2024, 61(5) : 1113 - 1127
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(5): 1113-1127
• Special Issue on Large Models and Safety •
JADE-DB:A Universal Testing Benchmark for Large Language Model Safety Based on Targeted Mutation
Full
Mi Zhang, Xudong Pan, Min Yang*
Affiliations
  • School of Computer Science, Fudan University, Shanghai 200433
  • born in 1980. PhD, professor. Member of CCF. Her main research interests include machine learning and AI security

    born in 1996. PhD, assistant professor. Member of CCF. His main research interests include machine learning and AI security

    born in 1979. PhD, professor. Distinguished member of CCF. His main research interests include system security and AI security

About Author:

born in 1980. PhD, professor. Member of CCF. Her main research interests include machine learning and AI security

born in 1996. PhD, assistant professor. Member of CCF. His main research interests include machine learning and AI security

born in 1979. PhD, professor. Distinguished member of CCF. His main research interests include system security and AI security

Published: 2024-05-01 doi: 10.7544/issn1000-1239.202330959
Outline
收藏切换

We propose a universal safety testing benchmark for large language models (LLMs), JADE-DB. The benchmark is automatically constructed via the targeted mutation approach, which is able to convert test questions that are manually crafted by experienced LLM testers and multidisciplinary experts to highly threatening universal test questions. The converted questions still preserve the naturalness of human language without changing the core semantics of the original question, and in the meantime are able to consistently break over ten widely-used LLMs. Based on the incremental linguistic complexity, JADE-DB incorporates three levels of LLM safety testing, namely, basic, advanced and dangerous, which accounts for thousands of test questions covering 4 major unsafe generation categories, i.e., crime, tort, bias and core values, spanning over 30 unsafe topics. Specifically, we construct three dangerous safety benchmarks respectively for the three groups of LLMs, i.e., eight open-sourced Chinese, six commercial Chinese and four commercial English LLMs. The benchmarks simultaneously trigger harmful generation of multiple LLMs, with an average unsafe generation ratio of 70%. The results indicate that, due to the complexity of human language, most of the current best LLMs can hardly learn the infinite number of different syntactic structures of human language and thus recognize the invariant evil therein.

generative AI safety  /  large language models  /  safety evaluation for large language models  /  AI safety  /  natural language processing
张谧, 潘旭东, 杨珉. JADE-DB:基于靶向变异的大语言模型安全通用基准测试集. 计算机研究与发展, 2024 , 61 (5) : 1113 -1127 . DOI: 10.7544/issn1000-1239.202330959
Mi Zhang, Xudong Pan, Min Yang. JADE-DB:A Universal Testing Benchmark for Large Language Model Safety Based on Targeted Mutation[J]. Journal of Computer Research and Development, 2024 , 61 (5) : 1113 -1127 . DOI: 10.7544/issn1000-1239.202330959
Year 2024 volume 61 Issue 5
88
41
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202330959
  • Receive Date:2023-11-30
  • Online Date:2026-11-17
  • Published:2024-05-01
Article Data
Affiliations
History
  • Received:2023-11-30
  • Revised:2024-02-29
Affiliations
    School of Computer Science, Fudan University, Shanghai 200433
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330959
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT