收藏切换
A LiDAR-Based Dynamic Driving Scene Multi-task Segmentation Network
收藏切换
PDF
Hai Wang1, Jianguo Li1, Yingfeng Cai2, Long Chen2
Automotive Engineering | 2024, 46(9) : 1608 - 1616
Less
收藏切换
Automotive Engineering | 2024, 46(9): 1608-1616
A LiDAR-Based Dynamic Driving Scene Multi-task Segmentation Network
Full
Hai Wang1, Jianguo Li1, Yingfeng Cai2, Long Chen2
Affiliations
  • 1. School of Automotive and Traffic Engineering,Jiangsu University,Zhenjiang 212013
  • 2. Automotive Engineering Research Institute,Jiangsu University,Zhenjiang 212013
Published: 2024-09-25 doi: 10.19562/j.chinasae.qcgc.2024.09.008
Outline
收藏切换

In autonomous driving scene understanding task, accurate segmentation of drivable areas, dynamic and static objects is essential for subsequent local motion planning and motion control. However, the current general semantic segmentation method based on lidar point cloud cannot achieve real-time and robust prediction on vehicle-end edge computing devices, and cannot predict the motion state of objects at the current moment. In order to solve this problem, a multi-task segmentation network MultiSegNet for driving areas and dynamic and static objects is proposed in this paper. The network uses the depth map output by the lidar and the processed residual image as the representation of the encoded spatial features and motion features to input to the network for feature learning, so as to avoid directly processing disordered high-density point clouds. For the large difference in the number of target distributions in different directions of the depth map, a variable resolution grouping input strategy is proposed, which can reduce the amount of network computation and improve the segmentation accuracy of the network. In order to adapt to the size of the convolutional receptive field required for targets at different scales, a depth-value-guided hierarchical dilated convolution module is proposed. At the same time, in order to effectively correlate and fuse the spatial position and attitude information of objects in different time domains, a spatiotemporal motion feature enhancement network is proposed. The effectiveness of the proposed MultiSegNet is verified on the large-scale point cloud driving scene datasets SemanticKITTI and nuScenes. The results show that the segmentation IoU of driving area, static object and dynamic object reaches 98%, 97% and 70%, respectively, which is better than that of mainstream networks, with real-time inference realized on edge computing devices.

autonomous driving  /  lidar  /  multi-task point cloud segmentation network  /  dynamic object segmentation
Hai Wang, Jianguo Li, Yingfeng Cai, Long Chen. A LiDAR-Based Dynamic Driving Scene Multi-task Segmentation Network[J]. Automotive Engineering, 2024 , 46 (9) : 1608 -1616 . DOI: 10.19562/j.chinasae.qcgc.2024.09.008
Year 2024 volume 46 Issue 9
PDF
293
130
Cite this Article
BibTeX
Article Info
doi: 10.19562/j.chinasae.qcgc.2024.09.008
  • Receive Date:2024-01-23
  • Online Date:2025-07-29
  • Published:2024-09-25
Article Data
Affiliations
History
  • Received:2024-01-23
  • Revised:2024-04-23
Funding
Affiliations
    1. School of Automotive and Traffic Engineering,Jiangsu University,Zhenjiang 212013
    2. Automotive Engineering Research Institute,Jiangsu University,Zhenjiang 212013
References
Share
https://castjournals.cast.org.cn/joweb/qcygc/EN/10.19562/j.chinasae.qcgc.2024.09.008
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT