收藏切换
A Machine Unlearning Method via Feature Constraint and Adaptive Loss Balance
收藏切换
Yuyu Yin1, 2, Guangqiang Wu1, Youhuizi Li1, 2, *, Xinyu Wang1, Honghao Gao3, 4
Journal of Computer Research and Development | 2024, 61(10) : 2649 - 2661
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(10): 2649-2661
• Artificial Intelligence Security for Data Elements •
A Machine Unlearning Method via Feature Constraint and Adaptive Loss Balance
Full
Yuyu Yin1, 2, Guangqiang Wu1, Youhuizi Li1, 2, *, Xinyu Wang1, Honghao Gao3, 4
Affiliations
  • 1School of Computer Science, Hangzhou Dianzi University, Hangzhou 310018
  • 2Key Laboratory of Complex Systems Modeling and Simulation (Hangzhou Dianzi University), Ministry of Education, Hangzhou 310018
  • 3School of Computer Engineering and Science, Shanghai University, Shanghai 200444
  • 4Department of Computer Engineering, Gachon University, Seongnam, Republic of Korea 461701
  • born in 1980. PhD, professor. Member of CCF. His main research interests include service computing, edge computing, and business process management

    born in 1999. Master. His main research interests include machine unlearning, deep learning, and incremental learning

    born in 1989. PhD, associate professor. Member of CCF. Her main research interests include edge computing, privacy security, and mobile edge computing

    born in 2000. Master. His main research interests include edge computing, deep learning, and natural language processing

    born in 1985. PhD, associate professor. Member of CCF. His main research interests include software formal verification, service collaborative computing, wireless networks and industrial Internet of things, and intelligent medical image processing

About Author:

born in 1980. PhD, professor. Member of CCF. His main research interests include service computing, edge computing, and business process management

born in 1999. Master. His main research interests include machine unlearning, deep learning, and incremental learning

born in 1989. PhD, associate professor. Member of CCF. Her main research interests include edge computing, privacy security, and mobile edge computing

born in 2000. Master. His main research interests include edge computing, deep learning, and natural language processing

born in 1985. PhD, associate professor. Member of CCF. His main research interests include software formal verification, service collaborative computing, wireless networks and industrial Internet of things, and intelligent medical image processing

Published: 2024-10-01 doi: 10.7544/issn1000-1239.202440476
Outline
收藏切换

With the accelerated advancement of digitization, data elements have become the core driving force for the operation of modern society. However, at the same time, data security issues have become increasingly prominent, with frequent occurrences of data breaches and privacy violations, causing serious losses to individuals, organizations, and even countries. Against this backdrop, the security of data elements has become the focus of attention from all sectors of society, and the issue of data privacy protection in deep learning models has also attracted widespread attention. Among them, machine unlearning, as a key technology for protecting user’s privacy, aims to enable models to remove the influence of specific data while maintaining generalization performance for remaining data, providing an effective solution for protecting the security of data elements in deep learning models. Existing machine unlearning methods are mainly divided into two categories: exact unlearning and approximate unlearning. However, exact unlearning methods need to intervene in the original training process of the models, while approximate unlearning methods find it difficult to strike a balance between unlearning performance and model generalization ability. To address these issues, we propose an approximate unlearning framework based on feature constraints and adaptive loss balancing. We adopt a “forgetting-recovering” machine unlearning framework. First, for the “forgetting” process, in order to mimic the feature outputs of retrained models for the forgetting samples, we use a randomly initialized model that has not been trained on the forgetting samples to guide the feature outputs of the unlearning model, constraining forgetting at the feature level to avoid easily obtaining forgetting data information from the model. Then, a small amount of data is used for fine-tuning to “recover” the generalization performance of models on the remaining data. At the same time, we regard the above machine unlearning framework as a multi-task optimization problem and introduce adaptive loss balance to automatically balance the “forgetting” and “recovering” tasks, preventing the model from “over-forgetting” or “over-recovering”, so that the “forgetting” and “recovering” tasks can be trained relatively balanced and steadily. Extensive experiments on 3 image classification datasets show that our method can effectively forget the forgetting data and achieve optimal performance in multiple metrics.

data element security  /  machine unlearning  /  feature constraints  /  multi-task optimization  /  adaptive loss balance
殷昱煜, 吴广强, 李尤慧子, 王鑫雨, 高洪皓. 基于特征约束和自适应损失平衡的机器遗忘方法. 计算机研究与发展, 2024 , 61 (10) : 2649 -2661 . DOI: 10.7544/issn1000-1239.202440476
Yuyu Yin, Guangqiang Wu, Youhuizi Li, Xinyu Wang, Honghao Gao. A Machine Unlearning Method via Feature Constraint and Adaptive Loss Balance[J]. Journal of Computer Research and Development, 2024 , 61 (10) : 2649 -2661 . DOI: 10.7544/issn1000-1239.202440476
Year 2024 volume 61 Issue 10
64
31
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440476
  • Receive Date:2024-06-03
  • Online Date:2026-11-17
  • Published:2024-10-01
Article Data
Affiliations
History
  • Received:2024-06-03
  • Revised:2024-07-19
Affiliations
    1School of Computer Science, Hangzhou Dianzi University, Hangzhou 310018
    2Key Laboratory of Complex Systems Modeling and Simulation (Hangzhou Dianzi University), Ministry of Education, Hangzhou 310018
    3School of Computer Engineering and Science, Shanghai University, Shanghai 200444
    4Department of Computer Engineering, Gachon University, Seongnam, Republic of Korea 461701
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440476
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT