At present, complex interstitial lung diseases have the problems of low classification accuracy and lack of auxiliary diagnostic information. To address these problems, an image retrieval framework based on multi-feature fusion and supervised contrastive learning methods was proposed. Interstitial lung disease features were extracted using Res-Net50 and radiomics feature extraction modules. In order to fuse two features of different modalities and scales, a feature fusion module was designed that can jointly represent the spatial calculation feature correlation of two features. The feature discrimination between interstitial lung disease categories was improved through supervised contrastive learning methods, and a typical interstitial lung disease database was retrieved. The highest precision, recall rate and F1 score were obtained in the retrieval task of interstitial lung disease data, and a silhouette coefficient of 0.482 was obtained in the feature vector discrimination index for image retrieval. The experimental results show that compared with the traditional deep learning single feature modality method, the proposed method can effectively improve the classification retrieval accuracy of interstitial lung disease images and improve the interpretability of interstitial lung disease diagnosis.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |