收藏切换
Continual Completion for Dynamic Multimodal Knowledge Graphs via Semantic Alignment and Adaptive Replay Enhancement
收藏切换
Di Wang1, Junping Du1, *, Zhe Xue1, Guanhua Ye1, Tong Zhao1, Xiaolong Meng1, Haisheng Li2
Journal of Computer Research and Development | 2026, 63(9) : 2215 - 2230
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(9): 2215-2230
• Special Issue on Frontier Technologies and Applications of Knowledge-Enhanced Artificial Intelligence •
Continual Completion for Dynamic Multimodal Knowledge Graphs via Semantic Alignment and Adaptive Replay Enhancement
Full
Di Wang1, Junping Du1, *, Zhe Xue1, Guanhua Ye1, Tong Zhao1, Xiaolong Meng1, Haisheng Li2
Affiliations
  • 1School of Computer Science(National Pilot School of Software Engineering), Beijing University of Posts and Telecommunications, Beijing 100876
  • 2School of Computer and Artificial Intelligence, Beijing Technology and Business University, Beijing 100048
  • born in 1999. PhD candidate. Student member of CCF. Her main research interests include knowledge representation learning and artificial intelligence

    born in 1963. Professor. Fellow of CCF. Her main research interests include artificial intelligence and pattern recognition

    born in 1987. Professor. Member of CCF. His main research interests include machine learning and data mining

    born in 1997. Associate professor. Member of CCF. His main research interests include machine learning and distributed collaboration

    born in 1993. PhD candidate. Her main research interests include data mining and artificial intelligence

    born in 2000. PhD candidate. His main research interests include data mining and large language model

    born in 1974. Professor. Distinguished member of CCF. His main research interests include computer graphics and data mining

About Author:

born in 1999. PhD candidate. Student member of CCF. Her main research interests include knowledge representation learning and artificial intelligence

born in 1963. Professor. Fellow of CCF. Her main research interests include artificial intelligence and pattern recognition

born in 1987. Professor. Member of CCF. His main research interests include machine learning and data mining

born in 1997. Associate professor. Member of CCF. His main research interests include machine learning and distributed collaboration

born in 1993. PhD candidate. Her main research interests include data mining and artificial intelligence

born in 2000. PhD candidate. His main research interests include data mining and large language model

born in 1974. Professor. Distinguished member of CCF. His main research interests include computer graphics and data mining

Published: 2026-09-01 doi: 10.7544/issn1000-1239.202660445
Outline
收藏切换

To meet the demand for dynamic knowledge updating and long-term knowledge retention in knowledge-enhanced artificial intelligence, dynamic multimodal knowledge graph continual completion infers missing facts incrementally as graph snapshots evolve while keeping historical knowledge stable. It thus provides fundamental support for dynamic knowledge updates. Existing methods predominantly focus on single-modal structural information, failing to fully exploit textual and visual semantics; directly incorporating multimodal information may introduce unexpected semantic shifts across snapshots, thereby exacerbating catastrophic forgetting. To this end, we propose SAREC, a semantic alignment and adaptive replay enhanced method for dynamic multimodal knowledge graph continual completion. SAREC leverages large language models to generate entity semantic descriptions and combines them with vision-language pretrained representations to construct a multimodal discrepancy-aware fusion mechanism, enhancing the completeness and robustness of entity representations. A multimodal temporal semantic alignment module is further introduced to constrain cross-snapshot representation evolution and maintain semantic consistency. Finally, a temporal-aware adaptive replay mechanism is proposed, which dynamically allocates the replay budget according to snapshot recency and selectively replays historical knowledge to alleviate catastrophic forgetting. Experiments demonstrate that SAREC achieves superior performance under various knowledge evolution modes, providing effective support for continual knowledge injection and adaptive knowledge enhancement in open dynamic environments.

multimodal knowledge graph completion  /  continual learning  /  dynamic knowledge updating  /  large language model  /  catastrophic forgetting
王迪, 杜军平, 薛哲, 叶冠华, 赵桐, 孟晓龙, 李海生. 语义对齐与自适应回放增强的动态多模态知识图谱持续补全. 计算机研究与发展, 2026 , 63 (9) : 2215 -2230 . DOI: 10.7544/issn1000-1239.202660445
Di Wang, Junping Du, Zhe Xue, Guanhua Ye, Tong Zhao, Xiaolong Meng, Haisheng Li. Continual Completion for Dynamic Multimodal Knowledge Graphs via Semantic Alignment and Adaptive Replay Enhancement[J]. Journal of Computer Research and Development, 2026 , 63 (9) : 2215 -2230 . DOI: 10.7544/issn1000-1239.202660445
Year 2026 volume 63 Issue 9
92
44
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202660445
  • Receive Date:2026-06-06
  • Online Date:2026-11-17
  • Published:2026-09-01
Article Data
Affiliations
History
  • Received:2026-06-06
  • Revised:2026-07-17
Affiliations
    1School of Computer Science(National Pilot School of Software Engineering), Beijing University of Posts and Telecommunications, Beijing 100876
    2School of Computer and Artificial Intelligence, Beijing Technology and Business University, Beijing 100048
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202660445
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT