To address the issue that the single red-green-blue (RGB) modality contains limited semantic information, is susceptible to noise interference, and exhibits suboptimal segmentation performance, this paper proposes an RGB-depth (RGB-D) semantic segmentation algorithm based on an asymmetric feature interaction method. First, a two-stream network is employed to extract features from the RGB and depth modalities separately. By incorporating an asymmetric feature correction module, features from one modality are used to correct those of the other, thereby suppressing intra-modal noise. Then, an asymmetric fusion module is applied to further enhance information interaction between the modalities. Additionally, multi-scale feature fusion is introduced in the decoder, and adversarial training is adopted as an auxiliary strategy during the training process to effectively leverage contextual information and improve overall accuracy. Experimental results demonstrate that the proposed algorithm effectively suppresses intra-modal noise and enhances the interaction of valid semantic information across modalities,achieving mean intersection over union(mIoU)scores of 57.4% and 52.1% on the New York University depth dataset v2(NYUDepthv2)and the Stanford University RGB-D dataset(SUN-RGBD),respectively.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |