收藏切换
Requirement Ambiguity Detection Method Based on Large Language Model
收藏切换
Juntao Gao1, Fang Liu1, Yilong Yang2, *
Journal of Computer Research and Development | 2026, 63(4) : 827 - 853
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(4): 827-853
• Special Issue on LLMs and Software Engineering •
Requirement Ambiguity Detection Method Based on Large Language Model
Full
Juntao Gao1, Fang Liu1, Yilong Yang2, *
Affiliations
  • 1School of Computer and Information Technology, Northeast Petroleum University, Daqing, Heilongjiang 163318
  • 2School of Software, Beihang University, Beijing 100080
  • born in 1979. PhD, associate professor. Member of CCF. His main research interests include data analysis, process mining, business process management, and software engineering

    born in 1999. Master. Her main research interests include static analysis of requirements, and ambiguity detection and resolution

    born in 1988. PhD, associate professor. Member of CCF. His main research interests include intelligent requirements engineering, intelligent software engineering, and intelligent system engineering

About Author:

born in 1979. PhD, associate professor. Member of CCF. His main research interests include data analysis, process mining, business process management, and software engineering

born in 1999. Master. Her main research interests include static analysis of requirements, and ambiguity detection and resolution

born in 1988. PhD, associate professor. Member of CCF. His main research interests include intelligent requirements engineering, intelligent software engineering, and intelligent system engineering

Published: 2026-04-01 doi: 10.7544/issn1000-1239.202550700
Outline
收藏切换

In modern software development, requirements ambiguity is a key factor that leads to project failure, cost overruns, and quality issues. Therefore, the automatic detection of requirement ambiguity has been extensively studied. Although these methods reduce the time cost of manual review, their solutions are incomplete for the types of ambiguity detection, and it is difficult to fully cover the six types of ambiguity corresponding to language ambiguity. The traditional method lacks the ability of in-depth semantic understanding, logical relationship recognition and quotation/referential relationship recognition, which limits its semantic processing ability and cannot detect pragmatic ambiguity and linguistic error ambiguity. To this end, we propose a large language model-based method called LMAdetect for automatic detection of requirements ambiguity. For a given requirement, LMAdetect analyzes the requirement according to the heuristic rules and the large language model, and classifies the requirement detection into the corresponding ambiguity type. However, large language models often classify different types of ambiguity, and for the classification results of large language models, LMAdetect uses a rule-based algorithm to assign different types of ambiguity to different experts for detection. Finally, the detection results are summarized according to the confidence level, and the classification results with high confidence are output. Experiments on 1192 data of 6 ambiguity types show that compared with the traditional rule-based method, the F1 score of LMAdetect is increased by 34.4%, and compared with the method based on large language model, the F1 score is increased by 31.6%, and the F1 score of pragmatic ambiguity and linguistic error ambiguity detection reaches 0.6950 and 0.8889, respectively, demonstrating its advantages in requirement ambiguity detection.

requirement ambiguity  /  detection  /  large language model  /  classification  /  semantic understanding
高俊涛, 刘芳, 杨溢龙. 基于大语言模型的需求歧义检测方法. 计算机研究与发展, 2026 , 63 (4) : 827 -853 . DOI: 10.7544/issn1000-1239.202550700
Juntao Gao, Fang Liu, Yilong Yang. Requirement Ambiguity Detection Method Based on Large Language Model[J]. Journal of Computer Research and Development, 2026 , 63 (4) : 827 -853 . DOI: 10.7544/issn1000-1239.202550700
Year 2026 volume 63 Issue 4
119
57
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550700
  • Receive Date:2025-09-21
  • Online Date:2026-11-17
  • Published:2026-04-01
Article Data
Affiliations
History
  • Received:2025-09-21
  • Revised:2025-12-29
Affiliations
    1School of Computer and Information Technology, Northeast Petroleum University, Daqing, Heilongjiang 163318
    2School of Software, Beihang University, Beijing 100080
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550700
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT