收藏切换
Transformer Interpretation Method Based on Sequential Three-Way Mask and Attention Fusion
收藏切换
Xiaotian Cheng, Weiping Ding*, Yu Geng, Jiashuang Huang, Hengrong Ju, Jing Guo
Journal of Computer Research and Development | 2025, 62(11) : 2737 - 2751
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(11): 2737-2751
• Artificial Intelligence •
Transformer Interpretation Method Based on Sequential Three-Way Mask and Attention Fusion
Full
Xiaotian Cheng, Weiping Ding*, Yu Geng, Jiashuang Huang, Hengrong Ju, Jing Guo
Affiliations
  • School of Artificial Intelligence and Computer Science, Nantong University, Nantong, Jiangsu 226019
  • born in 2001. Master candidate. His main research interests include granular computing, deep learning, and computer vision

    born in 1979. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include data mining, machine learning, granular computing, evolutionary computing, and big data analytics

    born in 1998. Master. His main research interests include granular computing, machine learning, and deep learning

    born in 1988. PhD, associate professor. His main research interests include brain network analysis and deep learning

    born in 1989. PhD, associate professor. His main research interests include granular computing, rough sets, machine learning, and knowledge discovery

    born in 2000. Master candidate. Her main research interests include granular computing, machine learning, and deep learning

About Author:

born in 2001. Master candidate. His main research interests include granular computing, deep learning, and computer vision

born in 1979. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include data mining, machine learning, granular computing, evolutionary computing, and big data analytics

born in 1998. Master. His main research interests include granular computing, machine learning, and deep learning

born in 1988. PhD, associate professor. His main research interests include brain network analysis and deep learning

born in 1989. PhD, associate professor. His main research interests include granular computing, rough sets, machine learning, and knowledge discovery

born in 2000. Master candidate. Her main research interests include granular computing, machine learning, and deep learning

Published: 2025-11-01 doi: 10.7544/issn1000-1239.202440382
Outline
收藏切换

Transformer has gradually become the preferred solution for computer vision tasks, which has promoted the development of its interpretability methods. Traditional interpretation methods mostly use the perturbation mask generated by the Transformer encoder’s final layer to generate an interpretable map. However, these methods ignore uncertain information on the mask and the information loss in the upsampling and downsampling processes, which can result in rough and incomplete positioning of the object area. To overcome the mentioned problems, a Transformer explanation method based on sequential three-way and attention fusion (SAF-Explainer) is proposed. SAF-Explainer mainly includes the sequential three-way mask (S3WM) module and attention fusion (AF) module. The S3WM module processes the mask by applying strict threshold conditions to avoid the uncertainty information in the mask from damaging the interpretation results, so as to effectively locate the object position. Subsequently, AF module uses attention matrix aggregation to generate a relationship matrix for cross-layer information interaction, which is used to optimize the detailed information in the interpretation results and generates clear and complete interpretation results. To verify the effectiveness of the proposed SAF-Explainer, comparative experiments are conducted on three natural image datasets and one medical image dataset. The results show that SAF-Explainer has better explainability. This work advances visual explanation techniques by providing more accurate and clinically relevant interpretability for Transformer-based vision systems, particularly in medical diagnostic applications where precise region identification is crucial.

interpretable method  /  Transformer  /  self-attention mechanism  /  sequential three-way decision  /  attention fusion  /  perturbation mask
成晓天, 丁卫平, 耿宇, 黄嘉爽, 鞠恒荣, 郭静. 基于序贯三支掩码和注意力融合的Transformer解释方法. 计算机研究与发展, 2025 , 62 (11) : 2737 -2751 . DOI: 10.7544/issn1000-1239.202440382
Xiaotian Cheng, Weiping Ding, Yu Geng, Jiashuang Huang, Hengrong Ju, Jing Guo. Transformer Interpretation Method Based on Sequential Three-Way Mask and Attention Fusion[J]. Journal of Computer Research and Development, 2025 , 62 (11) : 2737 -2751 . DOI: 10.7544/issn1000-1239.202440382
Year 2025 volume 62 Issue 11
152
61
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440382
  • Receive Date:2024-05-31
  • Online Date:2026-11-10
  • Published:2025-11-01
Article Data
Affiliations
History
  • Received:2024-05-31
  • Revised:2025-03-10
  • Accepted:2025-04-04
Affiliations
    School of Artificial Intelligence and Computer Science, Nantong University, Nantong, Jiangsu 226019
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440382
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT