收藏切换
Graph Operator-Based Dynamically Scalable Optimization Method for Deep Computing on Mobile Devices
收藏切换
Shiyan Luo1, Sicong Liu1, *, Bin Guo1, Cheng Fang1, Minfan Wang1, Sai Guo1, Zhiwen Yu1, 2
Journal of Computer Research and Development | 2025, 62(12) : 3122 - 3146
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(12): 3122-3146
• Network and Information Security •
Graph Operator-Based Dynamically Scalable Optimization Method for Deep Computing on Mobile Devices
Full
Shiyan Luo1, Sicong Liu1, *, Bin Guo1, Cheng Fang1, Minfan Wang1, Sai Guo1, Zhiwen Yu1, 2
Affiliations
  • 1School of Computer Science, Northwestern Polytechnical University, Xi’an 710072
  • 2Harbin Engineering University, Harbin 150006
  • born in 2002. Master. Her main research interests include AIoT system and mobile computing

    born in 1992. PhD, associate professor. Her main research interests include AIoT system and mobile computing

    born in 1980. PhD, professor. His main research interests include ubiquitous computing, crowdsensing, mobile crowdsensing

    born in 2000. Master. His main research interests include AIoT system and mobile computing

    born in 2002. Master. Her main research interests include AIoT system and mobile computing

    born in 2001. Master. His main research interest includes computer vison

    born in 1977. PhD, professor. His main research interests include ubiquitous computing and AIoT system

About Author:

born in 2002. Master. Her main research interests include AIoT system and mobile computing

born in 1992. PhD, associate professor. Her main research interests include AIoT system and mobile computing

born in 1980. PhD, professor. His main research interests include ubiquitous computing, crowdsensing, mobile crowdsensing

born in 2000. Master. His main research interests include AIoT system and mobile computing

born in 2002. Master. Her main research interests include AIoT system and mobile computing

born in 2001. Master. His main research interest includes computer vison

born in 1977. PhD, professor. His main research interests include ubiquitous computing and AIoT system

Published: 2025-12-01 doi: 10.7544/issn1000-1239.202440701
Outline
收藏切换

In recent years, it has become a trend to introduce deep neural network (DNN) into mobile devices. Many applications that facilitate daily life, such as voice assistants and activity recognition, have been integrated into smartphones, wearable devices, and embedded systems. However, it is challenging to deploy CPU-bound DNN on mobile devices with limited resources, such as computing power, storage, and battery. Existing methods, such as manually designed DNN compression techniques and automated on-demand DNN compression techniques, are limited to optimizing model structures. It restricts the upper limit of performance optimization for DNN deployment and makes it difficult to adapt to devices with extremely constrained resources. In addition, these statically pre-designed optimization methods do not consider the resource contention and dynamic demand characteristics of the deployment environment in mobile applications. The inability to adjust strategies in real-time under dynamic environment results in suboptimal accuracy-efficiency performance. To address these challenges, we propose AdaInfer, a runtime-scalable cross-layer optimization method for DNN. AdaInfer adaptively selects the optimal comprehensive deployment strategy for model layers, computational graph layers, and memory layers based on current hardware resource constraints and user performance requirements to optimize multiple performance metrics. It also adjusts the optimal strategy in real-time as the scenario changes. Specifically, we design a scalable graph-computation structure that is model-agnostic and a corresponding cross-layer optimization strategy. These are capable of automatically adjusting to maximize deployment efficiency on heterogeneous devices. Then, we model the runtime adjustment problem of the algorithm-system cross-layer optimization strategy as a dynamic optimization problem and represent the dynamic environment through a set of runtime-varying resource constraints. We also propose an efficient search strategy to enhance the efficiency and quality of local online searches. In evaluations conducted on three types of mobile and edge devices, five models, and four continuously changing mobile scenarios, experimental results show that compared with previous work, AdaInfer reduces memory usage by up to 42.35% and latency by up to 73.89% without significantly affecting accuracy.

deep learning  /  mobile computing  /  model compression  /  computation graph optimization  /  memory scheduling
罗诗妍, 刘思聪, 郭斌, 方程, 王敏帆, 郭赛, 於志文. 一种可动态伸缩的移动端深度计算图算优化方法. 计算机研究与发展, 2025 , 62 (12) : 3122 -3146 . DOI: 10.7544/issn1000-1239.202440701
Shiyan Luo, Sicong Liu, Bin Guo, Cheng Fang, Minfan Wang, Sai Guo, Zhiwen Yu. Graph Operator-Based Dynamically Scalable Optimization Method for Deep Computing on Mobile Devices[J]. Journal of Computer Research and Development, 2025 , 62 (12) : 3122 -3146 . DOI: 10.7544/issn1000-1239.202440701
Year 2025 volume 62 Issue 12
113
52
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440701
  • Receive Date:2024-08-29
  • Online Date:2026-11-10
  • Published:2025-12-01
Article Data
Affiliations
History
  • Received:2024-08-29
  • Revised:2025-04-11
Affiliations
    1School of Computer Science, Northwestern Polytechnical University, Xi’an 710072
    2Harbin Engineering University, Harbin 150006
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440701
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT