收藏切换
A Collaborative Perception and Tracking Method Based on Radar and Camera
收藏切换
PDF
Ming LIU1, 2, 3, Yongjun FANG2, 3, Han WU2, Qiankun LI2, Dongdong LI2, Zhaoyang ZHANG1, 3
Radio Engineering | 2025, 55(11) : 2131 - 2141
Less
收藏切换
Radio Engineering | 2025, 55(11): 2131-2141
Signal and Information Processing
A Collaborative Perception and Tracking Method Based on Radar and Camera
Full
Ming LIU1, 2, 3, Yongjun FANG2, 3, Han WU2, Qiankun LI2, Dongdong LI2, Zhaoyang ZHANG1, 3
Affiliations
  • 1.Zhejiang University,Hangzhou 310058, China
  • 2.Zhejiang Dahua Technology Co. , Ltd. , Hangzhou 310053, China
  • 3.Zhejiang Provincial Key Laboratory of Harmonized Technology of Vision & Transmission,Hangzhou 310053,China
Published: 2025-11-05 doi: 10.3969/j.issn.1003-3106.2025.11.001
Outline
收藏切换

In traffic surveillance systems, radar-camera devices are used to collaboratively perceive and monitor the roadside environment. Due to the principles of perspective imaging, the greater the distance to a target, the smaller its corresponding pixel area in the image. Furthermore, the bounding boxes generated by visual detection exhibit significant jitter. If calibration errors or visual occlusion exist, or if the detection boxes shake, a significant error will be introduced when the target' s position is mapped from the image coordinate system to the radar coordinate system, affecting tracking accuracy. This is especially true for collaborative target sensing and tracking with multiple sensors, which further increases the difficulty. To address these challenges, a multi-sensor, multi-target collaborative perception and tracking method is proposed, leveraging a two-stage matching strategy and an adaptive Kalman filter. This method improves association precision by adding a secondary matching strategy of Perspective View (PV) plane after the Bird's Eye View (BEV) plane is associated with the data of frame before and after. This effectively solves the problem of low tracking accuracy for distant targets caused by significant mapping errors. Based on the relationship model between image points and range-position jitter, an adaptive multi-sensor multi-target tracking method is proposed. By using the relationship model to update the parameters of the Kalman filter, and adaptively selecting the appropriate observation matrix and measurement covariance matrix according to the target sensor data source, the position and velocity parameters of the target are estimated. This effectively improves the real-time prediction accuracy of the target' s spatial position and velocity, and further enhances the accuracy of target association in the BEV plane. Experimental results show that the proposed method improves the Multiple Object Tracking Accuracy ( MOTA) index by 16.3% compared to the method without the two-stage matching strategy and only using the ordinary Kalman filter, significantly improving the accuracy of target perception and tracking in traffic scenes using millimeter-wave radar and vision integrated systems.

multi-target tracking  /  Kalman filter  /  multi-sensor tracking  /  adaptive Kalman  /  roadside scene
Ming LIU, Yongjun FANG, Han WU, Qiankun LI, Dongdong LI, Zhaoyang ZHANG. A Collaborative Perception and Tracking Method Based on Radar and Camera[J]. Radio Engineering, 2025 , 55 (11) : 2131 -2141 . DOI: 10.3969/j.issn.1003-3106.2025.11.001
Year 2025 volume 55 Issue 11
PDF
173
81
Cite this Article
BibTeX
Article Info
doi: 10.3969/j.issn.1003-3106.2025.11.001
  • Receive Date:2025-07-06
  • Online Date:2026-04-17
  • Published:2025-11-05
Article Data
Affiliations
History
  • Received:2025-07-06
Affiliations
    1.Zhejiang University,Hangzhou 310058, China
    2.Zhejiang Dahua Technology Co. , Ltd. , Hangzhou 310053, China
    3.Zhejiang Provincial Key Laboratory of Harmonized Technology of Vision & Transmission,Hangzhou 310053,China
References
Share
https://castjournals.cast.org.cn/joweb/wxdgc/EN/10.3969/j.issn.1003-3106.2025.11.001
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT