The growth period of rice is an important reference indicator for irrigation, fertilization, and pest control measures in rice planting management. Researching an intelligent recognition method for rice growth period based on multimodal fusion, improving the accuracy of rice growth period recognition, is of great significance for optimizing rice planting management measures and increasing rice yield.
To address the vulnerability of RGB images to lighting, an H-color channel image is extracted, and a dual-branch rice growth stage image recognition model based on residual network and attention mechanism is established; Due to the influence of meteorological factors on the length of rice growth period, a rice growth period meteorological identification model based on three meteorological factors and a bidirectional long-short period network is established; Using decision trees for decision-level multimodal feature fusion, multiple models were trained and tested on a self-built rice growth period dataset.
The improved rice growth period image recognition model achieved an accuracy of 84.25%, which is superior to traditional image recognition models such as ResNet50 and ConvNeXt. The multi-modality model based on images and meteorological achieved an accuracy of 87.66% in identifying 9 rice growth stages, which is superior to the single modality recognition model based on images and meteorology.
The multimodal recognition model based on image and meteorological fusion compensates for the shortcomings of single modal recognition methods. Compared with single modal recognition models, it has significantly improved the accuracy of identifying 9 rice growth stages.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |