Recent neural inverse rendering methods represent object geometry and materials with neural networks and learn network parameters from multi-view images through physically based rendering. However, these methods typically assume that the light source is located at an infinite distance, which seldomly holds in indoor scenarios that exhibit complex illumination. To address this issue, we propose a point cloud-based lighting representation method to model the spatially-varying and high-frequency lighting effects in indoor scenes. Our method first detects 2D light source masks in the input multi-view images, and then obtains a set of emitters through 3D reconstruction algorithm. We explicitly incorporate emitters in the Monte Carlo sampling, which improves the ability to model the specular effects, thus effectively alleviating the ambiguity in the inverse rendering process. Experiments on real and synthetic datasets demonstrate that the proposed method achieves the best performance in inverse rendering and can produce realistic relighting results.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |