收藏切换
A Plan Reuse Mechanism for LLM-Driven Agent
收藏切换
Guopeng Li, Ruiqi Wu, Haisheng Tan*, Guoliang Chen
Journal of Computer Research and Development | 2024, 61(11) : 2706 - 2720
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(11): 2706-2720
• Special Issue on Advanced Technologies of Artificial Intelligence of Things •
A Plan Reuse Mechanism for LLM-Driven Agent
Full
Guopeng Li, Ruiqi Wu, Haisheng Tan*, Guoliang Chen
Affiliations
  • School of Computer Science and Technology, University of Science and Technology of China, Hefei 230027
  • born in 1997. PhD candidate. His main research interests include edge intelligence, large language model-driven agent, and machine learning system

    born in 2003. Master candidate. His main research interests include edge computing, large language model, and machine learning system

    born in 1981. PhD, professor. Member of CCF. His main research interests include edge intelligence, and system and networking for AI

    born in 1938. Professor. Fellow of CCF. His main research interests include parallel algorithms, computer architectures, and computational intelligence

About Author:

born in 1997. PhD candidate. His main research interests include edge intelligence, large language model-driven agent, and machine learning system

born in 2003. Master candidate. His main research interests include edge computing, large language model, and machine learning system

born in 1981. PhD, professor. Member of CCF. His main research interests include edge intelligence, and system and networking for AI

born in 1938. Professor. Fellow of CCF. His main research interests include parallel algorithms, computer architectures, and computational intelligence

Published: 2024-11-01 doi: 10.7544/issn1000-1239.202440380
Outline
收藏切换

Integrating large language models (LLMs) into personal assistants, like Xiao Ai and Blue Heart V, effectively enhances their ability to interact with humans, solve complex tasks, and manage IoT devices. Such assistants are also termed LLM-driven agents. Upon receiving user requests, the LLM-driven agent generates plans using an LLM, executes these plans through various tools, and then returns the response to the user. During this process, the latency for generating a plan with an LLM can reach tens of seconds, significantly degrading user experience. Real-world dataset analysis shows that about 30% of the requests received by LLM-driven agents are identical or similar, which allows the reuse of previously generated plans to reduce latency. However, it is difficult to accurately define the similarity between the request texts received by the LLM-driven agent through directly evaluating the original request texts. Moreover, the diverse expressions of natural language and the unstructured format of plan texts make implementing plan reuse challenging. To address these issues, we present and implement a plan reuse mechanism for LLM-driven agents called AgentReuse. AgentReuse leverages the similarities and differences among requests’ semantics and uses intent classification to evaluate the similarities between requests and enable the reuse of plans. Experimental results based on a real-world dataset demonstrate that AgentReuse achieves a 93% effective plan reuse rate, an F1 score of 0.9718, and an accuracy of 0.9459 in evaluating request similarities, reducing latency by 93.12% compared with baselines without using the reuse mechanism.

artificial intelligence of things  /  large language models (LLMs)  /  agent  /  semantic cache  /  similarity evaluation
李国鹏, 吴瑞骐, 谈海生, 陈国良. 面向大语言模型驱动的智能体的计划复用机制. 计算机研究与发展, 2024 , 61 (11) : 2706 -2720 . DOI: 10.7544/issn1000-1239.202440380
Guopeng Li, Ruiqi Wu, Haisheng Tan, Guoliang Chen. A Plan Reuse Mechanism for LLM-Driven Agent[J]. Journal of Computer Research and Development, 2024 , 61 (11) : 2706 -2720 . DOI: 10.7544/issn1000-1239.202440380
Year 2024 volume 61 Issue 11
93
47
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440380
  • Receive Date:2024-05-31
  • Online Date:2026-11-17
  • Published:2024-11-01
Article Data
Affiliations
History
  • Received:2024-05-31
  • Revised:2024-07-11
Affiliations
    School of Computer Science and Technology, University of Science and Technology of China, Hefei 230027
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440380
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT