收藏切换
RGB-D Semantic Segmentation Based on Asymmetric Feature Rectification and Fusion
收藏切换
PDF
Xindong YOU1, Wentao SHEN1, Jing HAN1, Xueqiang LYU1, 2, Zangtai CAI2
Journal of Beijing University of Posts and Telecommunications | 2025, 48(5) : 159 - 166
Less
收藏切换
Journal of Beijing University of Posts and Telecommunications | 2025, 48(5): 159-166
REPORTS
RGB-D Semantic Segmentation Based on Asymmetric Feature Rectification and Fusion
Full
Xindong YOU1, Wentao SHEN1, Jing HAN1, Xueqiang LYU1, 2, Zangtai CAI2
Affiliations
  • 1.Beijing Key Laboratory of Internet Culture and Digital Dissemination Research, Beijing Information Science and Technology University, Beijing 100101, China
  • 2.The State Key Laboratory of Tibetan Intelligent Information Processing and Application, Qinghai Normal University, Xining 810008, China
doi: 10.13190/j.jbupt.2024-151
Outline
收藏切换

To address the issue that the single red-green-blue (RGB) modality contains limited semantic information, is susceptible to noise interference, and exhibits suboptimal segmentation performance, this paper proposes an RGB-depth (RGB-D) semantic segmentation algorithm based on an asymmetric feature interaction method. First, a two-stream network is employed to extract features from the RGB and depth modalities separately. By incorporating an asymmetric feature correction module, features from one modality are used to correct those of the other, thereby suppressing intra-modal noise. Then, an asymmetric fusion module is applied to further enhance information interaction between the modalities. Additionally, multi-scale feature fusion is introduced in the decoder, and adversarial training is adopted as an auxiliary strategy during the training process to effectively leverage contextual information and improve overall accuracy. Experimental results demonstrate that the proposed algorithm effectively suppresses intra-modal noise and enhances the interaction of valid semantic information across modalities,achieving mean intersection over union(mIoU)scores of 57.4% and 52.1% on the New York University depth dataset v2(NYUDepthv2)and the Stanford University RGB-D dataset(SUN-RGBD),respectively.

red-green-blue-depth semantic segmentation  /  encoder-decoder  /  red-green-blue-depth information complementary  /  deep learning
Xindong YOU, Wentao SHEN, Jing HAN, Xueqiang LYU, Zangtai CAI. RGB-D Semantic Segmentation Based on Asymmetric Feature Rectification and Fusion[J]. Journal of Beijing University of Posts and Telecommunications, 2025 , 48 (5) : 159 -166 . DOI: 10.13190/j.jbupt.2024-151
Year 2025 volume 48 Issue 5
PDF
73
36
Cite this Article
BibTeX
Article Info
doi: 10.13190/j.jbupt.2024-151
  • Receive Date:2024-07-17
  • Online Date:2026-04-16
Article Data
Affiliations
History
  • Received:2024-07-17
Affiliations
    1.Beijing Key Laboratory of Internet Culture and Digital Dissemination Research, Beijing Information Science and Technology University, Beijing 100101, China
    2.The State Key Laboratory of Tibetan Intelligent Information Processing and Application, Qinghai Normal University, Xining 810008, China
References
Share
https://castjournals.cast.org.cn/joweb/bjyddxxb/EN/10.13190/j.jbupt.2024-151
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT