In order to further improve the accuracy of human action recognition and fully explore the spatiotemporal features of action sequences, a graph convolution action recognition method based on spatiotemporal feature fusion and attention mechanism is proposed. The spatial attention map convolution is used to refine the topology to capture the correlation features of the joints under different motion types,and the time convolution structure is extended by the time domain multi-scale convolution module to capture the multi-scale time features. A multi-level feature fusion module is constructed,which takes the initial feature and the convolution output feature of the time-domain multiscale graph as the module input,and uses a two-branch structure to obtain the global and local channel features respectively. On this basis,a limb attention mechanism is proposed to divide the human topological structure and calculate the attention weights in the channel dimension respectively to enhance the model's ability to pay attention to local action features. The experimental results show that the recognition accuracy is 93.0% and 96.9% in CS and CV evaluation mode of NTU RGB+D data set,and 89.8% and 91.1% in X-Sub and X-Set evaluation mode of NTU RGB+D 120 data set,respectively. The recognition accuracy is higher than that of ST-GCN,CTR-GCN and other models.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |