born in 2001. Master candidate. His main research interest includes diffusion models
born in 1997. Master candidate. Her main research interest includes diffusion models
born in 1995. PhD candidate. Her main research interests include machine learning systems and model inference acceleration
born in 1989. PhD. His main research interests include image understanding and real-time systems
born in 1990. PhD. Member of CCF. His main research interests include intelligent robot system, edge computing, and system software
The diffusion models have made significant achievements in the field of image generation, but they still face some challenges such as high computational cost, long inference latency, and poor image generation quality during image generation. Based on previous research, we propose an efficient adaptive diffusion model inference method based on the warmup-aware and noise reuse methods, which can optimize the performance of the diffusion models according to input conditions and solve the problems of slow inference speed and poor image generation quality. Specifically, our warmup-aware method can dynamically adjust the number of warmup time steps in the initial stage of the diffusion process according to the semantic complexity of the input text prompts to ensure efficient initialization. Subsequently, our noise reuse method dynamically determines the number of time steps for noise reuse in the iterative refinement stage, and reduces unnecessary computational overhead. And we achieve 2.66 times acceleration on 4 NVIDIA V100 GPUs, and compared with DistriFusion, our inference speed increases by 12.8% and the image generation quality improves by 5.03 times. These improvements indicate that our proposed method has significant effects in balancing inference efficiency and image generation quality, and provides a scalable solution for real-time image generation applications.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |