AdaptDNN: An Adaptive and Scalable LLM Distributed Training System
1State Key Lab of Processors (Institute of Computing Technology, Chinese Academy of Sciences), Beijing 100190
2School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049
3Beijing Institute of Open Source Chip, Beijing 100080
|
born in 1997. PhD candidate. His main research interests include distributed systems and machine learning systems
|
|
born in 1999. Master candidate. His main research interests include operating systems and machine learning systems. (zhujiaqi22s@ict.ac.cn)
|
|
born in 2001. Master candidate. His main research interests include machine learning system, virtualization, and cloud computing. (gaoziyuan23s@ict.ac.cn)
|
|
born in 1980. PhD, professor. Member of CCF. His main research interests include data center architecture, agile design methodology of processor chips, and ecosystem of open-source processor chips. (baoyg@ict.ac.cn)
|
|
born in 1986. PhD, associate professor. Member of CCF. His main research interests include cloud computing, operating systems, and system modeling and performance analysis
|
收起