收藏切换
Optimizing Deep Neural Network Based on Interpretability Analysis
收藏切换
Huanhuan Wu1, Ruilin Xie1, Yuanxin Qiao1, Xiang Chen2, Zhanqi Cui1, *
Journal of Computer Research and Development | 2024, 61(1) : 209 - 220
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(1): 209-220
• Artificial Intelligence •
Optimizing Deep Neural Network Based on Interpretability Analysis
Full
Huanhuan Wu1, Ruilin Xie1, Yuanxin Qiao1, Xiang Chen2, Zhanqi Cui1, *
Affiliations
  • 1School of Computer Science, Beijing Information Science and Technology University, Beijing 100101
  • 2School of Information Science and Technology, Nantong University, Nantong, Jiangsu 226019
  • born in 1995. Master. Student member of CCF. Her main research interests include intelligent software engineering and trustworthy artificial intelligence

    born in 1996. Master candidate. Student member of CCF. His main research interests include intelligent software engineering and trustworthy artificial intelligence

    born in 1999. Master candidate. Student member of CCF. His main research interests include intelligent software engineering and trustworthy artificial intelligence

    born in 1980. PhD, associate professor, master supervisor. Senior member of CCF. His main research interests include software testing, software maintenance, empirical software engineering, and mining software repository

    born in 1984. PhD, professor, master supervisor. Senior member of CCF. His main research interests include intelligent software engineering and trustworthy artificial intelligence

About Author:

born in 1995. Master. Student member of CCF. Her main research interests include intelligent software engineering and trustworthy artificial intelligence

born in 1996. Master candidate. Student member of CCF. His main research interests include intelligent software engineering and trustworthy artificial intelligence

born in 1999. Master candidate. Student member of CCF. His main research interests include intelligent software engineering and trustworthy artificial intelligence

born in 1980. PhD, associate professor, master supervisor. Senior member of CCF. His main research interests include software testing, software maintenance, empirical software engineering, and mining software repository

born in 1984. PhD, professor, master supervisor. Senior member of CCF. His main research interests include intelligent software engineering and trustworthy artificial intelligence

Published: 2024-01-02 doi: 10.7544/issn1000-1239.202220803
Outline
收藏切换

In recent years, deep neural networks (DNN) have been widely used in many fields, even replacing human to make decisions in some safety-critical systems, such as autonomous driving and smart healthcare, which requires higher reliability of DNN. It is difficult to understand the internal prediction mechanism and debug because of the complex multi-layer nonlinear network structure of DNN. The existing DNN debugging work mainly improves the performance by adjusting the parameters and augments the training set to optimize DNN. However, it is difficult to control the modification range of adjusting parameters directly, and probably make the model lose the ability of fitting the training set. And unguided augmentation of training set will dramatically increase training costs. To address this problem, a DNN optimization method OptDIA (optimizing DNN based on interpretability analysis) is proposed. Interpretability analysis is conducted on the training process and the decision-making behavior of DNN. According to the interpretability analysis results, the original training data is split into different partitions to evaluate their influences on decision-making results of DNN. After that, the partitions of original training data are transformed with different probabilities to generate new training data, which are used to retrain DNN to improve the performance of the model. The experiments on nine DNNs trained by three datasets shows that OptDIA can improve the accuracy of DNNs by 0.39% to 2.15% and F1-score of DNNs by 0.11% to 2.03%.

deep neural network  /  DNN optimization  /  DNN defect  /  DNN performance  /  interpretability analysis
吴欢欢, 谢瑞麟, 乔塬心, 陈翔, 崔展齐. 基于可解释性分析的深度神经网络优化方法. 计算机研究与发展, 2024 , 61 (1) : 209 -220 . DOI: 10.7544/issn1000-1239.202220803
Huanhuan Wu, Ruilin Xie, Yuanxin Qiao, Xiang Chen, Zhanqi Cui. Optimizing Deep Neural Network Based on Interpretability Analysis[J]. Journal of Computer Research and Development, 2024 , 61 (1) : 209 -220 . DOI: 10.7544/issn1000-1239.202220803
Year 2024 volume 61 Issue 1
70
33
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202220803
  • Receive Date:2022-09-14
  • Online Date:2026-11-17
  • Published:2024-01-02
Article Data
Affiliations
History
  • Received:2022-09-14
  • Revised:2023-02-22
Affiliations
    1School of Computer Science, Beijing Information Science and Technology University, Beijing 100101
    2School of Information Science and Technology, Nantong University, Nantong, Jiangsu 226019
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202220803
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT