收藏切换
A Pre-trained Universal Knowledge Graph Reasoning Model Based on Rule Prompts
收藏切换
Yuanning Cui, Zequn Sun, Wei Hu*
Journal of Computer Research and Development | 2024, 61(8) : 2030 - 2044
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(8): 2030-2044
• Special Issue on Graph Machine Learning •
A Pre-trained Universal Knowledge Graph Reasoning Model Based on Rule Prompts
Full
Yuanning Cui, Zequn Sun, Wei Hu*
Affiliations
  • State Key Laboratory for Novel Software Technology (Nanjing University), Nanjing 210023
  • born in 1996. PhD candidate. His main research interests include knowledge graph, representation learning, and graph machine learning

    born in 1992. PhD, Yuxiu Young Scholar. Member of CCF. His main research interests include knowledge graph, representation learning, and entity alignment

    born in 1982. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include knowledge graph, database, and intelligent software

About Author:

born in 1996. PhD candidate. His main research interests include knowledge graph, representation learning, and graph machine learning

born in 1992. PhD, Yuxiu Young Scholar. Member of CCF. His main research interests include knowledge graph, representation learning, and entity alignment

born in 1982. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include knowledge graph, database, and intelligent software

Published: 2024-08-01 doi: 10.7544/issn1000-1239.202440133
Outline
收藏切换

A knowledge graph (KG) is a structured knowledge base that stores a massive amount of real-world knowledge, providing data support for numerous knowledge-driven downstream tasks. KGs often suffer from incompleteness, with many missing facts. Therefore, the KG reasoning task aims to infer new conclusions based on known facts to complete the KG. With the research and development of knowledge engineering and its commercial applications, numerous general and domain-specific KGs have been constructed. Existing KG reasoning models mostly focus on completing a single KG but lack general reasoning capabilities. Inspired by the general capabilities of pre-trained large language models in recent years, some pre-trained universal KG reasoning models have been proposed. Addressing the issue of existing pre-trained model being unable to identify high-quality reasoning patterns, we introduce a rule-based pre-trained universal KG reasoning model called RulePreM. It discovers and filters high-quality reasoning rules to enhance the reasoning abilities. The proposed model first constructs a relational IO graph based on reasoning rules and uses an encoder, RuleGNN, to encode the relations. The encoded relations are then used as prompts to encode entities in the KG. Finally, candidate entities are scored for prediction. Additionally, an attention mechanism that combines rule confidence is introduced to further reduce the impact of low-quality reasoning patterns. Experimental results demonstrate that the proposed model exhibits universal reasoning abilities on 43 different KGs, with average performance surpassing existing supervised and pre-trained models.

knowledge graph  /  rules  /  universal reasoning  /  pre-training  /  prompt learning  /  relational IO graph
崔员宁, 孙泽群, 胡伟. 基于规则提示的知识图谱通用推理预训练模型. 计算机研究与发展, 2024 , 61 (8) : 2030 -2044 . DOI: 10.7544/issn1000-1239.202440133
Yuanning Cui, Zequn Sun, Wei Hu. A Pre-trained Universal Knowledge Graph Reasoning Model Based on Rule Prompts[J]. Journal of Computer Research and Development, 2024 , 61 (8) : 2030 -2044 . DOI: 10.7544/issn1000-1239.202440133
Year 2024 volume 61 Issue 8
83
42
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440133
  • Receive Date:2024-03-15
  • Online Date:2026-11-17
  • Published:2024-08-01
Article Data
Affiliations
History
  • Received:2024-03-15
  • Revised:2024-04-26
Affiliations
    State Key Laboratory for Novel Software Technology (Nanjing University), Nanjing 210023
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440133
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT