For the problem that it is difficult for video vehicle detection models to extract rich target features in complex traffic monitoring scenarios,in this paper a new spatial-temporal feature fusion module SF-Module is established from the perspective of making full use of spatial-temporal feature information of video images. The multi-head self-attention mechanism in Transformer model is used to extract and fuse the temporal and spatial feature information of current and historical frames of video vehicle images to enrich the feature information of the target. On this basis,based on YOLOv8 network,the newly created spatio-temporal feature fusion module SF-Module is integrated in its neck network to mine spatio-temporal feature information of video image sequences. At the same time,the WIoU loss function is introduced as the prediction frame regression loss to reduce the harmful gradient generated by the low quality label frame,and the SFW-YOLOv8 video vehicle detection model is designed. Finally,the newly established SFW-YOLOv8 complex scene video vehicle detection model is tested on the UA-DETRAC dataset,and some images in the dataset are simulated to enhance the data on rainy and foggy days,so as to improve the generalization of the vehicle detection model. The experimental results show that the values of mAP50 and mAP50:5:95 of the SFW-YOLOv8 video vehicle detection model are 79.1% and 63.6%,which are 1.7% and 3.3% higher than that of the YOLOv8 model,respectively. The reasoning speed is 11 ms/ frame,which has excellent detection performance.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |