收藏切换
Underwater Insitu Weight Estimation Method for Chinese Mitten Crab Based on Binocular Vision and Improved YOLOv11-pose
收藏切换
Aoqiang LI1, 2, 3, Hangyu DAI1, 2, 3, Ya GUO1, 2, 3
Smart Agriculture | 2026, 8(1) : 192 - 202
Less
收藏切换
Smart Agriculture | 2026, 8(1): 192-202
• Information Processing and Decision Making •
Underwater Insitu Weight Estimation Method for Chinese Mitten Crab Based on Binocular Vision and Improved YOLOv11-pose
Full
Aoqiang LI1, 2, 3, Hangyu DAI1, 2, 3, Ya GUO1, 2, 3
Affiliations
  • 1.International Joint Research Center for Intelligent Optical Sensing and Applications at Jiangnan University, Wuxi 214122, China
  • 2.Key Laboratory of Advanced Process Control for Light Industry, Ministry of Education, Jiangnan University, Wuxi 214122, China
  • 3.School of Internet of Things Engineering, Jiangnan University, Wuxi 214122, China
  • LI Aoqiang, E-mail:

About Author:

LI Aoqiang, E-mail:

Published: 2026-01-30 doi: 10.12133/j.smartag.SA202505019
Outline
收藏切换

[Objective] With the accelerated development of large-scale and intelligent aquaculture, accurate estimation of the body weight of individual Chinese mitten crabs is critical for tasks such as precise feeding, disease prevention, and optimization of harvest decisions. Traditional methods of manually catching and weighing crabs are time-consuming, labor-intensive, and can cause stress or injury to the crabs, while also failing to provide real-time monitoring. To address the challenges posed by turbid water conditions in aquaculture, which lead to poor image quality and difficulty in feature extraction, a method is proposed for estimating Chinese mitten crab weight that combines binocular vision with deep learning–based keypoint detection. This approach achieves high-precision detection of anatomical keypoints on the crab, providing new technical support for precision aquaculture and intelligent management. [Methods] Based on a lightweight YOLOv11 framework, in its C3K2 module, MBConv depthwise-separable convolutions were incorporated to significantly reduce computational complexity and improve feature extraction efficiency. An EffectiveSE channel attention mechanism was introduced to adaptively emphasize important channel-wise features. To further enhance cross-scale information fusion, a spatial dynamic feature fusion module (SDFM) was added. The SDFM adaptively and weightedly fused local spatial attention with global channel attention, enabling detailed extraction of crab shell edges and anatomical keypoints. The improved YOLOv11-ES model could simultaneously output the crab's bounding box, the positions of four anatomical keypoints, and the crab's sex classification in a single forward pass. In the 3D reconstruction stage, calibrated stereo camera parameters were used, and a sparse keypoint matching strategy guided by the crab's sex and spatial geometric constraints was employed. High-confidence keypoint pairs were selected from the left and right views, and the true 3D coordinates of the crab's carapace length and width were computed by triangulation. Finally, the obtained carapace length, width, and sex label data were fed into a two-layer back-propagation (BP) neural network to perform a regression prediction of the individual crab's weight. [Results and Discussion] To validate the effectiveness and robustness of the proposed method, a dataset of Chinese mitten crab images with annotated keypoints was constructed under varying water turbidity and lighting conditions, and both ablation and comparative experiments were conducted. The YOLOv11-ES achieved a mean average precision at intersection over union (IOU) threshold of 0.5 (mAP@50) of 97.2% on the test set, which was 4.4 percentage points higher than the original YOLOv11 model. The keypoint detection component reached an mAP@50 of 96.7%, which was 3.6 percentage points higher than that of the original YOLOv11 model. In comparative experiments, YOLOv11-ES also demonstrated significant advantages over other models in the same series. Moreover, in a full-system evaluation using images of 30 individual crabs, the mean absolute percentage error (MAPE) for carapace width measurements was only 2.68%, and for carapace length it was 1.48%. The Pearson correlation coefficients between the measured and manually obtained true values for both carapace length and width exceeded 0.977, indicating high accuracy in the 3D reconstruction and minimal measurement error. Experiments analyzing the influence of image quality on measurement accuracy showed that when the underwater image quality measure (UIQM) reached at least 1.5, the combined MAPE of carapace length and width errors could be kept below 5%. When UIQM reached at least 2.2, the MAPE dropped to about 1.9%. These results confirmed the robustness of the method against variations in water turbidity and lighting conditions. For weight regression prediction, the BP network trained on carapace length, width, and sex features achieved a mean absolute error (MAE) of 2.39 g and a MAPE of 7.1% on an independent test set, demonstrating high-precision estimation of individual crab weight. [Conclusions] The proposed method, which combines an improved YOLOv11 object detection network, binocular sparse keypoint matching, and a two-layer BP regression network, enabled high-precision, low-error, real-time, non-contact estimation of Chinese mitten crab weight in complex turbid aquatic environments. This approach featured a lightweight model, high computational efficiency, excellent measurement accuracy, and strong adaptability to varying environmental conditions. It provided key technical parameters for intelligent Chinese mitten crab farming. In the future, this approach could be extended to other aquaculture species and complex farming scenarios. Combined with transfer learning and online adaptive calibration techniques, its generalization capability could be further improved and integrated with intelligent monitoring platforms to achieve large-scale, all-weather underwater crab weight estimation, contributing to the sustainable development of smart aquaculture.

Chinese mitten crab  /  keypoint detection  /  binocular vision  /  YOLOv11  /  weight estimation  /  insitu detection
李澳强, 戴航宇, 郭亚. 基于双目视觉和改进YOLOv11-pose的河蟹水下原位质量估测方法. 智慧农业(中英文), 2026 , 8 (1) : 192 -202 . DOI: 10.12133/j.smartag.SA202505019
Aoqiang LI, Hangyu DAI, Ya GUO. Underwater Insitu Weight Estimation Method for Chinese Mitten Crab Based on Binocular Vision and Improved YOLOv11-pose[J]. Smart Agriculture, 2026 , 8 (1) : 192 -202 . DOI: 10.12133/j.smartag.SA202505019
  • National Natural Science Foundation of China(51961125102)
  • Modern Agriculture Resersch Funds of Jiangsu Province(BE2022366)
Year 2026 volume 8 Issue 1
122
55
Cite this Article
BibTeX
Article Info
doi: 10.12133/j.smartag.SA202505019
  • Receive Date:2025-05-19
  • Online Date:2026-10-16
  • Published:2026-01-30
Article Data
Affiliations
History
  • Received:2025-05-19
Funding
National Natural Science Foundation of China(51961125102)
Modern Agriculture Resersch Funds of Jiangsu Province(BE2022366)
Affiliations
    1.International Joint Research Center for Intelligent Optical Sensing and Applications at Jiangnan University, Wuxi 214122, China
    2.Key Laboratory of Advanced Process Control for Light Industry, Ministry of Education, Jiangnan University, Wuxi 214122, China
    3.School of Internet of Things Engineering, Jiangnan University, Wuxi 214122, China

Corresponding:

GUO Ya, E-mail:
References
Share
https://castjournals.cast.org.cn/joweb/zhny/EN/10.12133/j.smartag.SA202505019
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT