收藏切换
Samples Dispatching Mechanism for Accelerating Recommendation Model Training in Edge Intelligent Computing System
收藏切换
Guopeng Li1, Haisheng Tan2, Chi Zhang1, Hongqiu Ni1, Zilong Wang1, Xinyue Zhang1, Yang Xu1, Han Tian1, Guoliang Chen1
Journal of Computer Research and Development | 2025, 62(6) : 1396 - 1415
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(6): 1396-1415
• Intelligent Computing •
Samples Dispatching Mechanism for Accelerating Recommendation Model Training in Edge Intelligent Computing System
Full
Guopeng Li1, Haisheng Tan2, Chi Zhang1, Hongqiu Ni1, Zilong Wang1, Xinyue Zhang1, Yang Xu1, Han Tian1, Guoliang Chen1
Affiliations
  • 1School of Computer Science and Technology, University of Science and Technology of China, Hefei 230027
  • 2School of Artificial Intelligence and Data Science, University of Science and Technology of China, Hefei 230027
  • born in 1997. PhD candidate. His main research interests include edge intelligence, large language model-based agent, and machine learning system

    born in 1981. PhD, professor. Member of CCF. His main research interests include edge intelligence, and system and networking for AI

    born in 1995. PhD, associate professor. His main research interests include edge computing and network algorithms

    born in 2000. PhD candidate. Her main research interests include edge computing, large language model inference, and machine learning system

    born in 2000. Master candidate. His main research interests include edge computing, scheduling mechanism, and machine learning system

    born in 2000. PhD candidate. Her main research interests include edge computing, serverless computing, and machine learning system

    born in 2003. Master candidate. His main research interests include edge computing, machine learning system, and large language model

    born in 1989. PhD, associate professor. His main research interest includes machine learning and its applications in networking, system and private computing

    born in 1938. Professor. Fellow of CCF. His main research interests include parallel algorithms, computer architectures, and computational intelligence

About Author:

born in 1997. PhD candidate. His main research interests include edge intelligence, large language model-based agent, and machine learning system

born in 1981. PhD, professor. Member of CCF. His main research interests include edge intelligence, and system and networking for AI

born in 1995. PhD, associate professor. His main research interests include edge computing and network algorithms

born in 2000. PhD candidate. Her main research interests include edge computing, large language model inference, and machine learning system

born in 2000. Master candidate. His main research interests include edge computing, scheduling mechanism, and machine learning system

born in 2000. PhD candidate. Her main research interests include edge computing, serverless computing, and machine learning system

born in 2003. Master candidate. His main research interests include edge computing, machine learning system, and large language model

born in 1989. PhD, associate professor. His main research interest includes machine learning and its applications in networking, system and private computing

born in 1938. Professor. Fellow of CCF. His main research interests include parallel algorithms, computer architectures, and computational intelligence

Published: 2025-06-02 doi: 10.7544/issn1000-1239.202550128
Outline
收藏切换

Using edge workers to train deep learning recommendation model (DLRM) in edge intelligent computing system brings several benefits, particularly in terms of data privacy protection, low latency and personalization. However, due to the huge size of embedding tables, typical DLRM training frameworks adopt one or more parameter servers to maintain global embedding tables, while leveraging several edge workers to cache part of them. This incurs significant transmission cost for embedding transmissions between workers and parameter servers, which can dominate the training cycle. In this paper, we investigate how to dispatch input embedding samples to appropriate edge workers to minimize the total embedding transmission cost when facing edge-specific challenges such as heterogeneous networks and limited resources. We develop ESD, a novel mechanism that optimizes the dispatching of input embedding samples to edge workers based on expected embedding transmission cost. We propose HybridDis as the dispatch decision method within ESD, which combines a resource-intensive optimal algorithm and a heuristic algorithm to balance decision quality and resource consumption. We implement a prototype of ESD using C++ and Python and compare it with state-of-the-art mechanisms on real-world workloads. Extensive experimental results show that ESD reduces the embedding transmission cost by up to 36.76% and achieves up to 1.74 times speedup in end-to-end DLRM training.

distributed training  /  edge intelligence  /  deep learning  /  recommendation model  /  dispatch mechanism
李国鹏, 谈海生, 张弛, 倪宏秋, 王子龙, 章馨月, 徐洋, 田晗, 陈国良. 边缘智能计算系统中加速推荐模型训练的样本调度机制. 计算机研究与发展, 2025 , 62 (6) : 1396 -1415 . DOI: 10.7544/issn1000-1239.202550128
Guopeng Li, Haisheng Tan, Chi Zhang, Hongqiu Ni, Zilong Wang, Xinyue Zhang, Yang Xu, Han Tian, Guoliang Chen. Samples Dispatching Mechanism for Accelerating Recommendation Model Training in Edge Intelligent Computing System[J]. Journal of Computer Research and Development, 2025 , 62 (6) : 1396 -1415 . DOI: 10.7544/issn1000-1239.202550128
Year 2025 volume 62 Issue 6
174
77
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202550128
  • Receive Date:2025-03-01
  • Online Date:2026-11-10
  • Published:2025-06-02
Article Data
Affiliations
History
  • Received:2025-03-01
  • Revised:2025-04-07
Affiliations
    1School of Computer Science and Technology, University of Science and Technology of China, Hefei 230027
    2School of Artificial Intelligence and Data Science, University of Science and Technology of China, Hefei 230027
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550128
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT