收藏切换
Survey on Neural Rendering and Its Hardware Acceleration
收藏切换
Xinkai Yan1, 3, Yuchi Huo1, 2, Hujun Bao1, 2, *
Journal of Computer Research and Development | 2024, 61(11) : 2846 - 2869
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(11): 2846-2869
• Graphics and Image Processing •
Survey on Neural Rendering and Its Hardware Acceleration
Full
Xinkai Yan1, 3, Yuchi Huo1, 2, Hujun Bao1, 2, *
Affiliations
  • 1State Key Lab of CAD & CG (Zhejiang University), Hangzhou 310058
  • 2Zhejiang Lab, Hangzhou 311121
  • 3Jiangsu Key Laboratory of ASIC Design (Wuxi) (Jiangsu Vocational College of Information Technology), Wuxi, Jiangsu 214153
  • born in 1989. PhD candidate, lecturer. His main research interests include computer architecture and AI & graphics chip design

    born in 1987. PhD, professor. His main research interests include computer graphics and computational optics

    born in 1966. PhD, professor. His main research interests include computer graphics and AR/VR

About Author:

born in 1989. PhD candidate, lecturer. His main research interests include computer architecture and AI & graphics chip design

born in 1987. PhD, professor. His main research interests include computer graphics and computational optics

born in 1966. PhD, professor. His main research interests include computer graphics and AR/VR

Published: 2024-11-01 doi: 10.7544/issn1000-1239.202330483
Outline
收藏切换

Neural rendering is a new image and video generation method based on deep learning. It combines the deep learning model with the physical knowledge of computer graphics to obtain a controllable and realistic scene model, and realize the control of scene attributes such as lighting, camera parameters, posture and so on. On the one hand, neural rendering can not only make full use of the advantages of deep learning to accelerate the traditional forward rendering process, but also provide new solutions for specific tasks such as inverse rendering and 3D reconstruction. On the other hand, the design of innovative hardware structures that adapt to the neural rendering pipeline breaks through the parallel computing and power consumption bottleneck of existing graphics processors, which is expected to provide important support for future key areas such as virtual and augmented reality, film and television creation and digital entertainment, artificial intelligence and metaverse. In this paper, we review the technical connotation, main challenges, and research progress of neural rendering. On this basis, we analyze the common requirements of neural rendering pipeline for hardware acceleration and the characteristics of the current hardware acceleration architecture, and then discuss the design challenges of neural rendering processor architecture. Finally, the future development trend of neural rendering processor architecture is prospected.

neural rendering  /  hardware acceleration  /  neural rending processing unit (NRPU)  /  multilayer perceptron (MLP)  /  ray marching  /  Hash table
严忻恺, 霍宇驰, 鲍虎军. 神经渲染及其硬件加速综述. 计算机研究与发展, 2024 , 61 (11) : 2846 -2869 . DOI: 10.7544/issn1000-1239.202330483
Xinkai Yan, Yuchi Huo, Hujun Bao. Survey on Neural Rendering and Its Hardware Acceleration[J]. Journal of Computer Research and Development, 2024 , 61 (11) : 2846 -2869 . DOI: 10.7544/issn1000-1239.202330483
Year 2024 volume 61 Issue 11
91
47
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202330483
  • Receive Date:2023-06-12
  • Online Date:2026-11-17
  • Published:2024-11-01
Article Data
Affiliations
History
  • Received:2023-06-12
  • Revised:2023-12-08
Affiliations
    1State Key Lab of CAD & CG (Zhejiang University), Hangzhou 310058
    2Zhejiang Lab, Hangzhou 311121
    3Jiangsu Key Laboratory of ASIC Design (Wuxi) (Jiangsu Vocational College of Information Technology), Wuxi, Jiangsu 214153
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330483
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT