收藏切换
Ontology-Graph Dual-Agent Reinforcement Learning Method for Temporal Knowledge Graph Reasoning
收藏切换
Yuehang Si1, Zefan Zeng1, Boyan Wang2, Jing Huo2, Yang Gao2, Jincai Huang1, *
Journal of Computer Research and Development | 2026, 63(9) : 2248 - 2263
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(9): 2248-2263
• Special Issue on Frontier Technologies and Applications of Knowledge-Enhanced Artificial Intelligence •
Ontology-Graph Dual-Agent Reinforcement Learning Method for Temporal Knowledge Graph Reasoning
Full
Yuehang Si1, Zefan Zeng1, Boyan Wang2, Jing Huo2, Yang Gao2, Jincai Huang1, *
Affiliations
  • 1College of Systems Engineering, University of Electronic National University of Defense Technology, Changsha 410073
  • 2National Key Laboratory of Novel Software Technology (Nanjing University), Nanjing 210023
  • born in 2000. PhD candidate. Student member of CCF. His main research interests include knowledge graph reasoning and large language models

    born in 1993. PhD. His main research interests include causal learning and strategic early warning

    born in 1990. PhD, assistant professor, PhD supervisor. Member of CCF. His main research interests include large scientific research models, multimodal alignment, and cognitive structure

    born in 1989. PhD, associate professor, PhD supervisor. Member of CCF. Her main research interests include generative artificial intelligence and embodied intelligence

    born in 1972. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include reinforcement learning, multi-agent systems, computer vision, and big data analysis

    born in 1973. PhD, professor, PhD supervisor. His main research interests include command and control, and artificial intelligence

About Author:

born in 2000. PhD candidate. Student member of CCF. His main research interests include knowledge graph reasoning and large language models

born in 1993. PhD. His main research interests include causal learning and strategic early warning

born in 1990. PhD, assistant professor, PhD supervisor. Member of CCF. His main research interests include large scientific research models, multimodal alignment, and cognitive structure

born in 1989. PhD, associate professor, PhD supervisor. Member of CCF. Her main research interests include generative artificial intelligence and embodied intelligence

born in 1972. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include reinforcement learning, multi-agent systems, computer vision, and big data analysis

born in 1973. PhD, professor, PhD supervisor. His main research interests include command and control, and artificial intelligence

Published: 2026-09-01 doi: 10.7544/issn1000-1239.202660408
Outline
收藏切换

Temporal knowledge graph (TKG) reasoning aims to predict future events based on historical facts. However, existing reinforcement learning (RL)-based reasoning methods merely conduct path searches at the entity level, lacking high-level semantic and logical guidance for the reasoning process. Moreover, ontologies, as conceptual abstractions of graphs, have strong logicality, but their construction typically relies on static statistical rules and is difficult to adapt dynamically to varying data distributions. To effectively address these issues, we propose ODRT, an ontology-graph dual-agent reinforcement learning method for TKG reasoning. Specifically, it jointly initializes the TKG ontology by leveraging both large language model (LLM) semantic embeddings and pretrained TKG reasoning model structural embeddings. Furthermore, it dynamically optimizes the ontology structure through learnable frequency weights during the end-to-end training process. Within the proposed dual-agent RL framework, the upper-level ontology agent performs concept-level walks on the constructed ontology graph, providing effective semantic navigation for the lower-level graph agent through carefully designed shared historical states. Meanwhile, the lower-level graph agent conducts fine-grained entity-level searches on the temporal graph under the constraint of hierarchical soft reward functions. Extensive experiments on four publicly available reasoning datasets demonstrate that ODRT achieves state-of-the-art performance among existing RL-based baselines and reaches the current state-of-the-art level on two encyclopedic datasets. However, on event-based datasets with heterogeneous entity behavior patterns and predictions that rely on historical reuse, its performance still lags behind that of partially embedded methods. Comprehensive experimental analyses further verify the significant advantages of the proposed ontology-guided mechanism and the dual-agent reinforcement learning framework.

knowledge graph  /  temporal knowledge graph reasoning  /  ontology  /  reinforcement learning  /  dual-agent
司悦航, 曾泽凡, 王博岩, 霍静, 高阳, 黄金才. 面向时序知识图谱推理的本体-图谱双智能体强化学习方法. 计算机研究与发展, 2026 , 63 (9) : 2248 -2263 . DOI: 10.7544/issn1000-1239.202660408
Yuehang Si, Zefan Zeng, Boyan Wang, Jing Huo, Yang Gao, Jincai Huang. Ontology-Graph Dual-Agent Reinforcement Learning Method for Temporal Knowledge Graph Reasoning[J]. Journal of Computer Research and Development, 2026 , 63 (9) : 2248 -2263 . DOI: 10.7544/issn1000-1239.202660408
Year 2026 volume 63 Issue 9
139
72
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202660408
  • Receive Date:2026-06-04
  • Online Date:2026-11-17
  • Published:2026-09-01
Article Data
Affiliations
History
  • Received:2026-06-04
  • Revised:2026-07-16
Affiliations
    1College of Systems Engineering, University of Electronic National University of Defense Technology, Changsha 410073
    2National Key Laboratory of Novel Software Technology (Nanjing University), Nanjing 210023
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202660408
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT