This study explored the application of the Segment Anything Model(SAM)series in digitalizing traditional Chinese medicine(TCM)inspection diagnosis research,aiming to reduce extensive manual annotation required for specific part segmentation models of tongue,face,eye,and hand under TCM theoretical guidance.
First,the Fast Segment Anything Model(Fast SAM)was used to perform unsupervised segmentation on images of the tongue,face and eyes. The evaluation of its ability to fully segment these areas indicated that FastSAM is highly effective in isolating the specific regions needed for TCM diagnostics. Secondly,SAM used with bounding box prompts,can compensate for Fast SAM's suboptimal performance in segmenting finer details such as cracks in the tongue,the forehead on the face,blood vessels in the eyes,and fingernails on the hands.
FastSAM achieved Intersection over Union(IOU)values exceeding 0.9 for both the tongue and facial areas,and over 0.8 for the ocular area,indicating its good performance in overall or partial image segmentation. Additionally,SAM demonstrated the excellent segmentation results for detailed areas that Fast SAM cannot handle.
The SAM series of models offers a novel segmentation approach for the subsequent analysis of image features in TCM inspection guided by TCM theory. It enables zeroshot segmentation of various TCM inspection images across different dimensions,potentially significantly reducing the manual annotation workload for TCM inspection image features. At the same time,it effectively enhances the accuracy and reliability of TCM inspection.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |