收藏切换
Semi-supervised Open Vocabulary Multi-label Learning Based on Graph Prompting
收藏切换
Zhongnian Li1, 3, Zhiyu Huangfu1, Kaijie Yang1, Peng Ying1, Tongfeng Sun1, 3, Xinzheng Xu1, 2, 3, *
Journal of Computer Research and Development | 2025, 62(2) : 432 - 442
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(2): 432-442
• Artificial Intelligence •
Semi-supervised Open Vocabulary Multi-label Learning Based on Graph Prompting
Full
Zhongnian Li1, 3, Zhiyu Huangfu1, Kaijie Yang1, Peng Ying1, Tongfeng Sun1, 3, Xinzheng Xu1, 2, 3, *
Affiliations
  • 1School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, Jiangsu 221116
  • 2State Key Laboratory of CAD & CG (Zhejiang University), Hangzhou 310058
  • 3Mine Digitization Engineering Research Center (China University of Mining and Technology), Ministry of Education, Xuzhou, Jiangsu 221116
  • born in 1990. PhD, lecturer. Member of CCF. His main research interests include data mining, machine learning, and information system

    born in 2000. Master. His main research interests include artificial intelligence and machine learning

    born in 2001. Master. His main research interests include artificial intelligence and machine learning

    born in 2001. PhD. Student member of CCF. His main research interests include artificial intelligence, data mining, and machine learning

    born in 1977. PhD, associate professor. Member of CCF. His main research interests include artificial intelligence, machine learning, and data mining

    born in 1980. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include artificial intelligence, machine learning, and medical image processing

About Author:

born in 1990. PhD, lecturer. Member of CCF. His main research interests include data mining, machine learning, and information system

born in 2000. Master. His main research interests include artificial intelligence and machine learning

born in 2001. Master. His main research interests include artificial intelligence and machine learning

born in 2001. PhD. Student member of CCF. His main research interests include artificial intelligence, data mining, and machine learning

born in 1977. PhD, associate professor. Member of CCF. His main research interests include artificial intelligence, machine learning, and data mining

born in 1980. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include artificial intelligence, machine learning, and medical image processing

Published: 2025-02-01 doi: 10.7544/issn1000-1239.202440123
Outline
收藏切换

Semi-supervised multi-label learning employs labeled and unlabeled data to train a model, which effectively achieves good results and reduces the labeling cost of multi-label data. Therefore, semi-supervised multi-label learning has attracted many researchers dedicated to this field. However, in the semi-supervised annotation process, due to the large number of labels, it is a common situation that some labels lack of samples, and these labels are called open vocabulary. It is difficult for the model to learn the label information of the open vocabulary, which leads to the degradation of its performance. To address the above problem, we propose a semi-supervised open vocabulary multi-label learning method based on graph prompting. Specifically, this method uses a graph neural network via prompt to fine-tune the pre-trained model and explore the relationship between open vocabulary and supervised samples. By using images and text, we construct a graph neural network as the input of text for the pre-trained model. Furthermore, by leveraging the generalization ability of the pre-trained model on open vocabulary, pseudo-labels are generated for unsupervised samples. Then we use pseudo-labels to train the classification layer and to enable the model to achieve better performance in classifying open vocabulary. Experimental results on multiple benchmark datasets, including VOC, COCO, CUB, and NUS, consistently demonstrate that the proposed method outperforms existing methods and achieves state-of-the-art performance.

semi-supervised multi-label learning  /  pre-trained model  /  graph neural network  /  open vocabulary  /  prompt
李仲年, 皇甫志宇, 杨凯杰, 营鹏, 孙统风, 许新征. 基于图提示的半监督开放词汇多标记学习. 计算机研究与发展, 2025 , 62 (2) : 432 -442 . DOI: 10.7544/issn1000-1239.202440123
Zhongnian Li, Zhiyu Huangfu, Kaijie Yang, Peng Ying, Tongfeng Sun, Xinzheng Xu. Semi-supervised Open Vocabulary Multi-label Learning Based on Graph Prompting[J]. Journal of Computer Research and Development, 2025 , 62 (2) : 432 -442 . DOI: 10.7544/issn1000-1239.202440123
Year 2025 volume 62 Issue 2
116
44
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440123
  • Receive Date:2024-03-01
  • Online Date:2026-11-10
  • Published:2025-02-01
Article Data
Affiliations
History
  • Received:2024-03-01
  • Revised:2024-10-31
  • Accepted:2024-11-13
Affiliations
    1School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, Jiangsu 221116
    2State Key Laboratory of CAD & CG (Zhejiang University), Hangzhou 310058
    3Mine Digitization Engineering Research Center (China University of Mining and Technology), Ministry of Education, Xuzhou, Jiangsu 221116
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440123
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT