收藏切换
Interleaved Text-Image Generation Method Based on Multi-Agent Debate
收藏切换
Jie Ma1, 2, Hanchi Zhang1, 2, Ning Qu2, 3, Haoquan Xue2, 3, Xinping Wang1, 2, Jun Liu2, 3, *
Journal of Computer Research and Development | 2026, 63(9) : 2264 - 2284
Less
收藏切换
Journal of Computer Research and Development | 2026, 63(9): 2264-2284
• Special Issue on Frontier Technologies and Applications of Knowledge-Enhanced Artificial Intelligence •
Interleaved Text-Image Generation Method Based on Multi-Agent Debate
Full
Jie Ma1, 2, Hanchi Zhang1, 2, Ning Qu2, 3, Haoquan Xue2, 3, Xinping Wang1, 2, Jun Liu2, 3, *
Affiliations
  • 1School of Cyber Science and Engineering, Faculty of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an 710049
  • 2Key Laboratory of Intelligent Network and Network Security (Xi’an Jiao Tong University), Ministry of Education, Xi’an 710049
  • 3School of Computer Science and Technology, Faculty of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an 710049
  • born in 1993. Associate professor, PhD supervisor. Member of CCF. His main research interests include multimodal content understanding, large model reasoning, and multi-agent systems

    born in 2001. PhD candidate. His main research interest includes self-evolution of multi-agent systems

    born in 2000. Master candidate. His main research interests include knowledge graphs and large language models

    born in 2002. Master candidate. His main research interest includes multimodal RAG

    born in 2004. Undergraduate. Her main research interest includes large language models

    born in 1973. Professor, PhD supervisor. Senior member of CCF. His main research interests include natural language understanding, computer vision, and smart education

About Author:

born in 1993. Associate professor, PhD supervisor. Member of CCF. His main research interests include multimodal content understanding, large model reasoning, and multi-agent systems

born in 2001. PhD candidate. His main research interest includes self-evolution of multi-agent systems

born in 2000. Master candidate. His main research interests include knowledge graphs and large language models

born in 2002. Master candidate. His main research interest includes multimodal RAG

born in 2004. Undergraduate. Her main research interest includes large language models

born in 1973. Professor, PhD supervisor. Senior member of CCF. His main research interests include natural language understanding, computer vision, and smart education

Published: 2026-09-01 doi: 10.7544/issn1000-1239.202660338
Outline
收藏切换

Multimodal retrieval-augmented generation introduces external textual and visual knowledge, providing important support for complex document understanding, knowledge-based question answering, and step-by-step task guidance. However, existing methods usually delegate the interleaved text-image generation process to a single multimodal large language model. Specifically, the retrieved text chunks, candidate images, and image descriptions are simultaneously fed into the same model, which is required to perform text organization, visual evidence selection, image insertion position determination, and multi-image ordering within a single generation process. In complex long-context scenarios, however, the candidate content often contains weakly relevant text, visually similar images, and redundant visual evidence, which can easily lead to missing key images, selecting irrelevant images, and misordering multiple images. To address these problems, we propose a multimodal retrieval-augmented interleaved text-image generation method based on a multi-agent debate mechanism. The proposed method decomposes the generation process into three collaborative roles: a text reasoning agent, a visual perception agent, and a global judge agent. Through dual-track draft generation, set conflict and ordering conflict detection, multi-round adversarial debate, and global judgment and fusion, the method jointly optimizes image selection, dynamic image supplementation, redundant image removal, and image reordering. Experimental results show that the proposed method achieves competitive performance across the network data, academic document, and lifestyle domains of MRAMG-Bench. In particular, in the lifestyle domain, compared with the strong baseline M2IO-R1, the proposed method improves image recall and ordering consistency by 7.02 and 7.77 percentage points, respectively. In the network data domain, the proposed method improves the average performance by 7.90 percentage points compared with the best complete baseline. These results demonstrate the effectiveness of the proposed method in complex long-document interleaved text-image generation tasks. Anonymous code and reproduction instructions are available at: https://github.com/mira-ai-lab/MRAMG-MultiAgent-Debate

multimodal retrieval-augmented generation  /  interleaved text-image generation  /  multi-agent debate  /  visual evidence selection  /  image ordering optimization  /  large language model
马杰, 张瀚驰, 渠宁, 薛皓荃, 王鑫平, 刘均. 基于多智能体辩论的图文交织生成方法. 计算机研究与发展, 2026 , 63 (9) : 2264 -2284 . DOI: 10.7544/issn1000-1239.202660338
Jie Ma, Hanchi Zhang, Ning Qu, Haoquan Xue, Xinping Wang, Jun Liu. Interleaved Text-Image Generation Method Based on Multi-Agent Debate[J]. Journal of Computer Research and Development, 2026 , 63 (9) : 2264 -2284 . DOI: 10.7544/issn1000-1239.202660338
Year 2026 volume 63 Issue 9
69
34
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202660338
  • Receive Date:2026-05-29
  • Online Date:2026-11-17
  • Published:2026-09-01
Article Data
Affiliations
History
  • Received:2026-05-29
  • Revised:2026-07-15
Affiliations
    1School of Cyber Science and Engineering, Faculty of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an 710049
    2Key Laboratory of Intelligent Network and Network Security (Xi’an Jiao Tong University), Ministry of Education, Xi’an 710049
    3School of Computer Science and Technology, Faculty of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an 710049
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202660338
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT