收藏切换
Frequency-enhanced and boundary-aware real-time pedestrian detection for autonomous driving
收藏切换
Tao Liu1, 2, Hui Ouyang1, *, Yimeng Gao3
Journal of Image and Graphics | 2026, 31(8) : 2925 - 2941
Less
收藏切换
Journal of Image and Graphics | 2026, 31(8): 2925-2941
• Image Analysis and Recognition •
Frequency-enhanced and boundary-aware real-time pedestrian detection for autonomous driving
Full
Tao Liu1, 2, Hui Ouyang1, *, Yimeng Gao3
Affiliations
  • 1 School of Software,Liaoning Technical University,Huludao 125105,China
  • 2 Department of Basic Teaching,Liaoning Technical University,Huludao 125105,China
  • 3 School of Electronic and Information Engineering,Liaoning Technical University,Huludao 125105,China
Published: 2026-08-16 doi: 10.11834/jig.250437
Outline
收藏切换
Objective

In autonomous driving scenarios,pedestrian detection performance can degrade substantially because of dramatic variations in pedestrian scale,frequent occlusions,and interference caused by complex backgrounds. To overcome these difficulties,we introduce a novel real-time pedestrian detection algorithm called frequency-enhanced and boundary-aware detection Transformer (FEBA-DETR),which integrates multiple frequency-domain enhancement strategies with a boundary-aware mechanism. By leveraging these complementary components,the proposed method achieves reliable pedestrian detection under the aforementioned challenging conditions.

Method

Real-time detection Transformer (RT-DETR) has demonstrated promising object detection performance,but it still faces challenges in capturing fine-grained details of objects at multiple scales,particularly for small objects,and in effectively leveraging frequency-domain information. To address these limitations,we propose an enhanced RT-DETR architecture that integrates several innovative modules and techniques. For improved backbone efficiency and feature propagation,our model incorporates cross-stage partial connections,which strengthen gradient flow across network stages and reduce redundant computations without sacrificing representation power. Building on this foundation,we introduce a frequency-aware module that explicitly harnesses high- and low-frequency visual cues to enrich the feature representations,ensuring that important textural and edge details are preserved and emphasized throughout the network. At the feature interaction level,we design a frequency-aware attention-based intra-scale feature interaction (FAIFI) mechanism. By enabling features at the same scale to communicate through attention operations modulated by frequency-domain signals,FAIFI allows the detector to capture subtle object characteristics that might otherwise be missed in single-scale processing. Moreover,we employ a boundary-aware feature aggregation (BAFA) strategy to improve multiscale feature fusion. BAFA focuses on preserving object boundary information when combining features from different resolution levels,thus helping maintain precise localization cues and contributing to accurate detection of objects with distinct edges. In addition to these architectural improvements,we refine the training process with an Inner-GIoU loss,a modified bounding box regression loss that places high emphasis on the overlapping area between predicted and ground-truth boxes. This tailored loss function drives the model to achieve tight and highly reliable localization. Furthermore,to bolster the model’s robustness and expand the diversity of training data,we introduce a novel frequency-based data augmentation approach that utilizes 2D discrete wavelet transform. By decomposing and altering the frequency components of training images,this augmentation method exposes the network to a broad variety of spatial-frequency patterns and helps prevent overfitting to common textures. Together,these enhancements considerably boost the detection accuracy and reliability of RT-DETR. Experiments on challenging object detection benchmarks indicate that the improved RT-DETR achieves higher average precision than its baseline counterpart,especially on small or texture-rich objects,and maintains real-time inference speed. Our results underscore the benefit of incorporating frequency-domain insights and boundary-aware feature processing into the RT-DETR framework for high-performance object detection.

Result

We rigorously evaluate our approach on three widely used person-detection benchmarks: CityPersons,WiderPersons,and ACDC. On CityPersons,our FEBA-DETR model achieves notable improvements over the baseline RT-DETR,with AP50 increasing by 2.3% and AP50:95 increasing by 2.0%; incorporating our data augmentation technique boosts performance,raising the aforementioned gains to 3% and 2.4%,respectively. On the occlusion-specific subsets of CityPersons,the miss rate decreases by 4.92% for the partially occluded “Reasonable” category and by 2.82% for the heavily occluded “Heavy” category. Similarly,on the challenging WiderPersons dataset,FEBA-DETR again surpasses the baseline,with AP50 and AP50:95 improvements of 1.1% and 0.7%,respectively. These consistent gains underscore the robust generalization of our method across diverse datasets. Moreover,on the ACDC dataset,which specifically assesses robustness in complex environmental scenarios,FEBA-DETR boosts AP50 and AP50:95 by 1.9% and 1.3%,respectively,with even greater improvements of 3.1% and 2.4%,respectively,after applying our data augmentation strategy. These extensive experimental results convincingly affirm the effectiveness of our multilevel frequency enhancement and boundary-awareness techniques,substantially advancing pedestrian detection in challenging autonomous driving contexts.

Conclusion

Experimental evaluations show that FEBA-DETR delivers notable advancements in detecting pedestrians,particularly those who are either small in scale or partially occluded. The model also maintains consistent performance under highly challenging and dynamic conditions. These findings underscore the practical advantages of incorporating frequency-domain enhancements and boundary-awareness strategies. Together,these design choices contribute to a dependable,accurate pedestrian detection system,which is especially valuable for autonomous driving applications where safety and precision are critical.

autonomous driving  /  pedestrian detection  /  small target detection  /  frequency domain enhancement  /  boundary awareness  /  data augmentation
刘涛, 欧阳晖, 高一萌. 频域增强与边界感知的自动驾驶实时行人检测. 中国图象图形学报, 2026 , 31 (8) : 2925 -2941 . DOI: 10.11834/jig.250437
Tao Liu, Hui Ouyang, Yimeng Gao. Frequency-enhanced and boundary-aware real-time pedestrian detection for autonomous driving[J]. Journal of Image and Graphics, 2026 , 31 (8) : 2925 -2941 . DOI: 10.11834/jig.250437
  • National Natural Science Foundation of China(61172144)
Year 2026 volume 31 Issue 8
22
10
Cite this Article
BibTeX
Article Info
doi: 10.11834/jig.250437
  • Receive Date:2025-09-12
  • Online Date:2026-10-30
  • Published:2026-08-16
Article Data
Affiliations
History
  • Received:2025-09-12
  • Revised:2025-11-20
Funding
National Natural Science Foundation of China(61172144)
Affiliations
    1 School of Software,Liaoning Technical University,Huludao 125105,China
    2 Department of Basic Teaching,Liaoning Technical University,Huludao 125105,China
    3 School of Electronic and Information Engineering,Liaoning Technical University,Huludao 125105,China
References
Share
https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/10.11834/jig.250437
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT