收藏切换
Generative Image Classification Method via Granularity-Guided Multi-Model Collaboration
收藏切换
Peng Ying1, 2, Zhongnian Li1, 2, Hongguang Yuan1, Meng Wei1, Xinzheng Xu1, 2, *
Journal of Computer Research and Development | 2026, 63(11) : 2986 - 3001
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(11): 2986-3001
• Artificial Intelligence •
Generative Image Classification Method via Granularity-Guided Multi-Model Collaboration
Full
Peng Ying1, 2, Zhongnian Li1, 2, Hongguang Yuan1, Meng Wei1, Xinzheng Xu1, 2, *
Affiliations
  • 1School of Computer Science and Technology / School of Artificial Intelligence, China University of Mining and Technology, Xuzhou, Jiangsu 221116
  • 2Mine Digitization Engineering Research Center of the Ministry of Education (China University of Mining and Technology), Xuzhou, Jiangsu 221116
  • born in 2001. PhD candidate. Student member of CCF. His main research interest includes machine learning

    born in 1990. PhD, lecturer. Member of CCF. His main research interest includes machine learning

    born in 2003. Master candidate. His main research interests include machine vision and image recognition

    born in 1997. PhD. Student member of CCF. His main research interests include machine learning and image recognition

    born in 1980. PhD, professor. Senior member of CCF. His main research interests include machine learning and medical image processing

About Author:

born in 2001. PhD candidate. Student member of CCF. His main research interest includes machine learning

born in 1990. PhD, lecturer. Member of CCF. His main research interest includes machine learning

born in 2003. Master candidate. His main research interests include machine vision and image recognition

born in 1997. PhD. Student member of CCF. His main research interests include machine learning and image recognition

born in 1980. PhD, professor. Senior member of CCF. His main research interests include machine learning and medical image processing

Published: 2026-11-01 doi: 10.7544/issn1000-1239.202550731
Outline
收藏切换

In recent years, large vision-language models (VLM) have demonstrated remarkable zero-shot prediction capabilities in image classification tasks. Existing VLM-based classification approaches typically rely on a set of predefined category labels or external textual knowledge bases as semantic prior to align and match visual content with language. However, in real-world applications, such predefined labels often fail to cover the vast and dynamic concept space of the open world, thereby limiting the adaptability and generalization ability of these models. To address this challenge, a more open-ended task, generative image classification (GIC), is introduced, in which no prior semantic labels are provided, and the target categories reside in an open-ended, potentially unbounded semantic space, substantially increasing the classification difficulty. To tackle the complexity of GIC, a granularity-guided multi-model collaboration framework is proposed, designed to fully leverage the strengths of VLM in both image understanding and text generation. In this framework, prompt templates are carefully crafted to guide VLM in generating candidate labels at varying levels of semantic granularity. Subsequently, the candidate label space is expanded by a language model that associates semantically related categories based on the generated image descriptions at each granularity level. Finally, the most relevant label is identified through a semantic similarity retrieval process in the embedding space. The effectiveness and superiority of the proposed method for the GIC task are validated through extensive experiments on multiple fine-grained image classification benchmarks.

generative image classification  /  vision-language models  /  multi-model collaboration  /  open vocabulary  /  multi-class
营鹏, 李仲年, 袁宏广, 魏孟, 许新征. 粒度引导多模型协作的生成式图像分类方法. 计算机研究与发展, 2026 , 63 (11) : 2986 -3001 . DOI: 10.7544/issn1000-1239.202550731
Peng Ying, Zhongnian Li, Hongguang Yuan, Meng Wei, Xinzheng Xu. Generative Image Classification Method via Granularity-Guided Multi-Model Collaboration[J]. Journal of Computer Research and Development, 2026 , 63 (11) : 2986 -3001 . DOI: 10.7544/issn1000-1239.202550731
Year 2026 volume 63 Issue 11
85
39
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550731
  • Receive Date:2025-09-30
  • Online Date:2026-11-17
  • Published:2026-11-01
Article Data
Affiliations
History
  • Received:2025-09-30
  • Revised:2026-09-07
Affiliations
    1School of Computer Science and Technology / School of Artificial Intelligence, China University of Mining and Technology, Xuzhou, Jiangsu 221116
    2Mine Digitization Engineering Research Center of the Ministry of Education (China University of Mining and Technology), Xuzhou, Jiangsu 221116
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550731
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT