born in 1999. PhD candidate. His main research interests include hallucination, security, and evaluation in LLMs
born in 1989. PhD, associate professor, master supervisor. His main research interests include system test and evaluation, and decision and analysis under uncertainty
born in 2003. PhD candidate. His main research interests include LLMs inference optimization, LLMs evaluation, and data stream mining. (chen_gz@nudt.edu.cn)
born in 2002. Master candidate. Her main research interests include natural language processing, large language models, and deep learning. (fangxinyue@nudt.edu.cn)
born in 1996. PhD candidate. His main research interests include causal inference, and equipment test and evaluation. (cuiruijing@nudt.edu.cn)
born in 1992. Associate professor. Member of CCF. His main research interests include LLMs and natural language processing. (tianzhiliang@nudt.edu.cn)
born in 1984. PhD, professor, PhD supervisor. Member of CCF. His main research interests include machine learning, natural language processing, and intelligent systems. (huangzhen@nudt.edu.cn)
born in 1977. PhD, professor, PhD supervisor. His main research interests include equipment test and evaluation, and defense acquisition and systems requirement modeling. (kayyang27@nudt.edu.cn)
In recent years, large language models (LLMs) have made significant strides in the field of natural language processing (NLP), demonstrating impressive capabilities in both language understanding and generation. However, despite these advancements, LLMs still face numerous challenges in practical applications. One such issue that has garnered extensive attention from both the academic and industrial communities is the problem of hallucinations. Effectively detecting hallucinations in large language models is a critical challenge for ensuring their reliable, secure, and trustworthy application in downstream tasks such as text generation. We provide a comprehensive review of methods for detecting hallucinations in large language models. Firstly, we introduce the concept of large language models and clarify the definition and classification of hallucinations. Then we systematically examine the characteristics of LLMs throughout their entire lifecycle, from construction to deployment, and delve into the mechanisms and causes of hallucinations. Secondly, based on practical application requirements and considering factors such as model transparency in different task scenarios, we categorize hallucination detection methods into two types: those for white-box models and those for black-box models. A focused review and in-depth comparison of these methods are provided. Then we analyze and summarize the current mainstream benchmarks for hallucination detection, laying a foundation for future research in this area. Finally, we identify various potential research directions and new challenges in the detection of hallucinations in large language models.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |