Pipe-RLHF: A Computation Mode-Aware Parallel Framework for RLHF
1Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190
2University of Chinese Academy of Sciences, Beijing 100190
3School of Control and Computer Engineering, North China Electric Power University, Beijing 102206
|
born in 1996. PhD candidate. Her main research interests include machine learning system and parallel deep learning framework
|
|
born in 1995. Assistant professor. Her main research interests include accelerator design and multi-core system
|
|
born in 1985. PhD, professor, PhD supervisor. His main research interest includes distributed computing and high-performance systems
|
|
born in 1999. PhD candidate. His main research interest includes LLM infrastructure、hardware-software co-design
|
|
born in 1999. PhD candidate. Her main research interest includes computer architecture
|
|
born in 1981. PhD, professor. Member of CCF. His main research interests include chip and computing system
|
|
born in 1985. PhD, professor. Senior member of CCF. His main research interests include novel EDA, and processor and memory system architecture
|
收起