Full
Outline
Wheat, as one of the world's essential food crops, requires timely diagnosis and control of diseases and pests to significantly reduce yield losses, which is crucial for global food security. However, deep learning methods typically rely on large amounts of training data and high-performance computing resources, which pose limitations in scenarios with small sample sizes and limited resources. To address these issues, a knowledge-enhanced lightweight multi-modal wheat diseases and pests identification model named multi-modal blend convolutional neural network (Blend-CNN) was proposed. The model was structured around a dual-branch convolutional neural network framework. It utilized an EfficientNet backbone network to extract image features of diseases and pests and incorporated a multi-branch TextCNN backbone network to extract textual features of diseases and pests descriptions, thereby obtaining more feature information and improving identification accuracy. Additionally, an innovative convolutional network-based multi-modal fusion method was introduced, allowing the model to optimally integrate information from both modalities globally. Furthermore, to mitigate the accuracy loss common in traditional multi-modal methods, the gradient blend loss function was developed. Finally, to verify the model's effectiveness, comparative experiments were conducted on a constructed dataset containing 880 samples. The results demonstrated that the proposed model achieved the highest identification accuracy of 96.95% on this dataset, compared with other models, it had fewer parameters, lower complexity, and it was more lightweight which was applicable for edge devices, offering theoretical support for wheat diseases and pests identification in scenarios with limited sample sizes and resources.
258
113
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |
关闭全屏
No. 86 Xueyuan South Road, Haidian District, Beijing
010-62662699(Operation and Technical Support)
qkjq@cast.org.cn
Copyright © 2025 China Association for Science and Technology. All rights reserved. For all open access content, the relevant licensing terms apply.
Sponsored by the Office of the Leading Group for Cybersecurity and Informatization of CAST, and supported by Science and Technology Review Publishing House
