收藏切换
A Collaborative Perception and Tracking Method Based on Radar and Camera
收藏切换
Ming LIU1, 2, 3, Yongjun FANG2, 3, Han WU2, Qiankun LI2, Dongdong LI2, Zhaoyang ZHANG1, 3
Radio Engineering | 2025, 55(11) : 2131 - 2141
Less
收藏切换
Radio Engineering | 2025, 55(11): 2131-2141
• Signal and Information Processing •
A Collaborative Perception and Tracking Method Based on Radar and Camera
Full
Ming LIU1, 2, 3, Yongjun FANG2, 3, Han WU2, Qiankun LI2, Dongdong LI2, Zhaoyang ZHANG1, 3
Affiliations
  • 1.Zhejiang University,Hangzhou 310058, China
  • 2.Zhejiang Dahua Technology Co. , Ltd. , Hangzhou 310053, China
  • 3.Zhejiang Provincial Key Laboratory of Harmonized Technology of Vision & Transmission,Hangzhou 310053,China
Published: 2025-11-05 doi: 10.3969/j.issn.1003-3106.2025.11.001
Outline
收藏切换

In traffic surveillance systems, radar-camera devices are used to collaboratively perceive and monitor the roadside environment. Due to the principles of perspective imaging, the greater the distance to a target, the smaller its corresponding pixel area in the image. Furthermore, the bounding boxes generated by visual detection exhibit significant jitter. If calibration errors or visual occlusion exist, or if the detection boxes shake, a significant error will be introduced when the target' s position is mapped from the image coordinate system to the radar coordinate system, affecting tracking accuracy. This is especially true for collaborative target sensing and tracking with multiple sensors, which further increases the difficulty. To address these challenges, a multi-sensor, multi-target collaborative perception and tracking method is proposed, leveraging a two-stage matching strategy and an adaptive Kalman filter. This method improves association precision by adding a secondary matching strategy of Perspective View (PV) plane after the Bird's Eye View (BEV) plane is associated with the data of frame before and after. This effectively solves the problem of low tracking accuracy for distant targets caused by significant mapping errors. Based on the relationship model between image points and range-position jitter, an adaptive multi-sensor multi-target tracking method is proposed. By using the relationship model to update the parameters of the Kalman filter, and adaptively selecting the appropriate observation matrix and measurement covariance matrix according to the target sensor data source, the position and velocity parameters of the target are estimated. This effectively improves the real-time prediction accuracy of the target' s spatial position and velocity, and further enhances the accuracy of target association in the BEV plane. Experimental results show that the proposed method improves the Multiple Object Tracking Accuracy ( MOTA) index by 16.3% compared to the method without the two-stage matching strategy and only using the ordinary Kalman filter, significantly improving the accuracy of target perception and tracking in traffic scenes using millimeter-wave radar and vision integrated systems.

multi-target tracking  /  Kalman filter  /  multi-sensor tracking  /  adaptive Kalman  /  roadside scene
刘明, 方勇军, 吴函, 李乾坤, 李冬冬, 张朝阳. 毫米波雷达与视觉一体机化多目标协同感知与跟踪方法. 无线电工程, 2025 , 55 (11) : 2131 -2141 . DOI: 10.3969/j.issn.1003-3106.2025.11.001
Ming LIU, Yongjun FANG, Han WU, Qiankun LI, Dongdong LI, Zhaoyang ZHANG. A Collaborative Perception and Tracking Method Based on Radar and Camera[J]. Radio Engineering, 2025 , 55 (11) : 2131 -2141 . DOI: 10.3969/j.issn.1003-3106.2025.11.001
Year 2025 volume 55 Issue 11
1376
680
Cite this Article
BibTeX
Article Info
doi: 10.3969/j.issn.1003-3106.2025.11.001
  • Receive Date:2025-07-06
  • Online Date:2026-04-17
  • Published:2025-11-05
Article Data
Affiliations
History
  • Received:2025-07-06
Affiliations
    1.Zhejiang University,Hangzhou 310058, China
    2.Zhejiang Dahua Technology Co. , Ltd. , Hangzhou 310053, China
    3.Zhejiang Provincial Key Laboratory of Harmonized Technology of Vision & Transmission,Hangzhou 310053,China
References
Share
https://castjournals.cast.org.cn/joweb/wxdgc/EN/10.3969/j.issn.1003-3106.2025.11.001
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT