收藏切换
Enhanced Cross-Modal Fine-Tuning Framework for Few-Shot Learning
收藏切换
Linlin Ding, Jialin Li, Jing Lu*, Mo Li, Aina Wang
Journal of Computer Research and Development | 2026, 63(7) : 1869 - 1883
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(7): 1869-1883
• Artificial Intelligence •
Enhanced Cross-Modal Fine-Tuning Framework for Few-Shot Learning
Full
Linlin Ding, Jialin Li, Jing Lu*, Mo Li, Aina Wang
Affiliations
  • Faculty of Information, Liaoning University, Shenyang 110036
  • born in 1983. Postdoc, professor, PhD supervisor. Member of CCF. Her main research interests include big data management, graph data management, knowledge graph, smart mining, and artificial intelligence

    born in 2002. Master candidate. Student member of CCF. Her main research interests include large models and vector databases. ()

    born in 1992. PhD, lecturer. Member of CCF. Her main research interests include data mining and distributed computing

    born in 1992. PhD, lecturer. Member of CCF. Her main research interests include database, knowledge graph, and graph data query. ()

    born in 1993. PhD, lecturer. Member of CCF. Her main research interests include optimal theory and applications, machine learning, and artificial intelligence. ()

About Author:

born in 1983. Postdoc, professor, PhD supervisor. Member of CCF. Her main research interests include big data management, graph data management, knowledge graph, smart mining, and artificial intelligence

born in 2002. Master candidate. Student member of CCF. Her main research interests include large models and vector databases. ()

born in 1992. PhD, lecturer. Member of CCF. Her main research interests include data mining and distributed computing

born in 1992. PhD, lecturer. Member of CCF. Her main research interests include database, knowledge graph, and graph data query. ()

born in 1993. PhD, lecturer. Member of CCF. Her main research interests include optimal theory and applications, machine learning, and artificial intelligence. ()

Published: 2026-07-01 doi: 10.7544/issn1000-1239.202550755
Outline
收藏切换

In recent years, large language model (LLM) has shown potential in multivariate time series forecasting. However, existing cross-modal methods based on LLM still face the challenges of insufficient modality alignment and limited generalization capability in few-shot learning and long-term forecasting tasks. To address the above issues, we propose an enhanced cross-modal LLM fine-tuning framework, termed Enhanced CALF, which integrates dynamic attention and hierarchical distillation. Firstly, the framework constructs a dynamic attention cross-modal matching module, introducing adaptive weight generation and alignment prediction mechanisms. This module can dynamically adjust the allocation of attention weights based on data distribution characteristics and inter-modality correlation strengths, thereby improving the precision of cross-modal feature alignment. Secondly, a multi-level knowledge distillation and contrastive learning module is built. By introducing projection mappings at each Transformer layer and combining hierarchical distillation loss with an adaptive temperature contrastive loss, it achieves hierarchical feature transmission covering aspects from local details to global semantics, aiming to enhance the consistency of cross-modal representations. Finally, an adaptive alignment mechanism is designed, which dynamically adjusts the weights of the total loss function through quantitative evaluation of inter-modality alignment scores, thereby optimizing the model training process. Experiments on seven real-world datasets demonstrate that Enhanced CALF outperforms existing baseline models in long-term forecasting and few-shot learning tasks.

large language model (LLM)  /  time series forecasting  /  knowledge distillation  /  contrastive learning  /  attention mechanism
丁琳琳, 李佳林, 卢晶, 李默, 王嫒娜. 面向少样本学习的增强式跨模态微调框架. 计算机研究与发展, 2026 , 63 (7) : 1869 -1883 . DOI: 10.7544/issn1000-1239.202550755
Linlin Ding, Jialin Li, Jing Lu, Mo Li, Aina Wang. Enhanced Cross-Modal Fine-Tuning Framework for Few-Shot Learning[J]. Journal of Computer Research and Development, 2026 , 63 (7) : 1869 -1883 . DOI: 10.7544/issn1000-1239.202550755
Year 2026 volume 63 Issue 7
84
38
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550755
  • Receive Date:2025-10-21
  • Online Date:2026-11-17
  • Published:2026-07-01
Article Data
Affiliations
History
  • Received:2025-10-21
  • Revised:2026-03-04
Affiliations
    Faculty of Information, Liaoning University, Shenyang 110036
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550755
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT