收藏切换
Personalized Federated Learning Method Based on Attention-Enhanced Meta-Learning Network
收藏切换
Yujia Gao1, 2, Pengfei Wang1, Liang Liu2, 3, *, Huadong Ma1, 2
Journal of Computer Research and Development | 2024, 61(1) : 196 - 208
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(1): 196-208
• Artificial Intelligence •
Personalized Federated Learning Method Based on Attention-Enhanced Meta-Learning Network
Full
Yujia Gao1, 2, Pengfei Wang1, Liang Liu2, 3, *, Huadong Ma1, 2
Affiliations
  • 1School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876
  • 2Beijing Key Laboratory of Intelligent Telecommunications Software and Multimedia (Beijing University of Posts and Telecommunications), Beijing 100876
  • 3School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876
  • born in 1995. PhD. Her main research interests include federated learning, deep learning, and intelligent sensing

    born in 1989. PhD, associate professor. His main research interests include data mining, machine learning, and recommendation system

    born in 1982. PhD, professor. Senior member of CCF. His main research interests include Internet of things and intelligence sensing

    born in 1964. PhD, professor, fellow of CCF, fellow of IEEE. His main research interests include Internet of things, sensor networks, multimedia system and networking

About Author:

born in 1995. PhD. Her main research interests include federated learning, deep learning, and intelligent sensing

born in 1989. PhD, associate professor. His main research interests include data mining, machine learning, and recommendation system

born in 1982. PhD, professor. Senior member of CCF. His main research interests include Internet of things and intelligence sensing

born in 1964. PhD, professor, fellow of CCF, fellow of IEEE. His main research interests include Internet of things, sensor networks, multimedia system and networking

Published: 2024-01-02 doi: 10.7544/issn1000-1239.202220922
Outline
收藏切换

Federated learning is a distributed machine learning framework, which enables clients to conduct model training without transmitting their data to the servers. It is used to solve the dilemma of data silos and data privacy. It can work well on clients with similar data characteristics and distribution. However, in many scenarios, the differences of data distribution cause difficulties in global model training. Therefore, personalized federated learning is proposed as a new federated learning paradigm. It aims to guarantee the effectiveness of client personalized models through the collaboration between clients and the servers. Intuitively, providing a tighter collaboration for clients with similar data characteristics and distribution can facilitate the construction of personalized models. However, due to the invisibility of client data, it is a challenge to extract client features at a fine-grained level and define the collaborative relationships between clients. In this paper, we design an attention-enhanced meta-learning network (AMN) to address this issue. AMN can utilize model parameters as features and train the meta-learning network to provide an additional meta-model for each client to automatically analyze client feature similarity. According to two-layers framework of AMN, a trade-off between clients’ personality and commonality can be reasonably achieved, and a hybrid model with useful information from all clients is provided. Considering the need to maintain both the meta-model and the client’s local model during the training process, we design an alternative training strategy to perform the training in an end-to-end manner. To demonstrate the effectiveness of our method, we conduct extensive experiments on two benchmark datasets and eight baseline methods. Compared with the existing best-performing personalized federated learning methods, our method improves the accuracy rate by 3.39% and 2.45% on average in two datasets.

federated learning  /  attention mechanism  /  deep learning  /  meta-learning  /  distributed machine learning
高雨佳, 王鹏飞, 刘亮, 马华东. 基于注意力增强元学习网络的个性化联邦学习方法. 计算机研究与发展, 2024 , 61 (1) : 196 -208 . DOI: 10.7544/issn1000-1239.202220922
Yujia Gao, Pengfei Wang, Liang Liu, Huadong Ma. Personalized Federated Learning Method Based on Attention-Enhanced Meta-Learning Network[J]. Journal of Computer Research and Development, 2024 , 61 (1) : 196 -208 . DOI: 10.7544/issn1000-1239.202220922
Year 2024 volume 61 Issue 1
80
38
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202220922
  • Receive Date:2022-11-03
  • Online Date:2026-11-17
  • Published:2024-01-02
Article Data
Affiliations
History
  • Received:2022-11-03
  • Revised:2023-03-22
Affiliations
    1School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876
    2Beijing Key Laboratory of Intelligent Telecommunications Software and Multimedia (Beijing University of Posts and Telecommunications), Beijing 100876
    3School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202220922
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT