Classification and Prediction of Skyrmion Material Based on Machine Learning

Classification and Prediction of Skyrmion Material Based on Machine Learning

PDF

Dan Liu¹^,^*, Zhixin Liu¹, JinE Zhang², Yinong Yin¹, Jianfeng Xi¹, Lichen Wang³, JieFu Xiong³, Ming Zhang⁴, Tongyun Zhao⁵, Jiaying Jin⁶, Fengxia Hu⁵, Jirong Sun⁵, Jun Shen⁷, Baogen Shen³^,⁵

Research. Vol 6 Article ID 0082

Less

Research. Vol 6 Article ID 0082

• Research Article •

Classification and Prediction of Skyrmion Material Based on Machine Learning

Full

Affiliations

¹Department of Physics, School of Artificial Intelligence, Beijing Technology and Business University, Beijing 100048, P. R. China.

²School of Integrated Circuit Science and Engineering, Beihang University, Beijing 100191, China.

³Ningbo Institute of Materials, Technology & Engineering, Chinese Academy of Sciences, Zhejiang 315201, P. R. China.

⁴School of Physics, Inner Mongolia University of Science and Technology, Baotou 014010, P. R. China.

⁵State Key Laboratory of Magnetism, Institute of Physics, Chinese Academy of Sciences, Beijing 100190, P. R. China.

⁶School of Materials Science and Engineering, Zhejiang University, Hangzhou 310027, P. R. China.

⁷Key Laboratory of Cryogenics, Technical Institute of Physics and Chemistry, Chinese Academy of Sciences, Beijing 100190, P. R. China.

Published: 2023-03-20 doi: 10.34133/research.0082

Outline

Abstract

Less

The discovery and study of skyrmion materials play an important role in basic frontier physics research and future information technology. The database of 196 materials, including 64 skyrmions, was established and predicted based on machine learning. A variety of intrinsic features are classified to optimize the model, and more than a dozen methods had been used to estimate the existence of skyrmion in magnetic materials, such as support vector machines, k-nearest neighbor, and ensembles of trees. It is found that magnetic materials can be more accurately divided into skyrmion and non-skyrmion classes by using the classification of electronic layer. Note that the rare earths are the key elements affecting the production of skyrmion. The accuracy and reliability of random undersampling bagged trees were 87.5% and 0.89, respectively, which have the potential to build a reliable machine learning model from small data. The existence of skyrmions in LaBaMnO is predicted by the trained model and verified by micromagnetic theory and experiments.

Cite this Article

Dan Liu, Zhixin Liu, JinE Zhang, Yinong Yin, Jianfeng Xi, Lichen Wang, JieFu Xiong, Ming Zhang, Tongyun Zhao, Jiaying Jin, Fengxia Hu, Jirong Sun, Jun Shen, Baogen Shen. Classification and Prediction of Skyrmion Material Based on Machine Learning[J]. Research, 2023 , 6 (3) : 0082 - . DOI: 10.34133/research.0082

Full Text

Less

Introduction

Less

Magnetic skyrmions are expected to be the next generation of information carriers with high capacity, high-speed reading and writing, low-power consumption, and nonvolatile information storage [1,2]. The skyrmions observed in the experiments are smaller than typical domain wall lengths, and the topological protection contributes to superior thermal stability, showing the exciting potential for encoding vast amounts of information [3,4]. The current density required to move skyrmion is about 10⁶ A/m², which is 4 to 5 orders of magnitude smaller than moving ferroelectric domain walls [4–6]. Due to the advantages of nanoscale, topological protection, and low spin current regulation, skyrmions are considered promising for spintronic applications. It is feasible to study skyrmions by traditional experimental methods of preparation and observation, but the randomness of the results and the variety of costs are unaffordable for ordinary institutions [7–10]. The essential reason for the low throughput of experimental data generation is the time-consuming and expensive synthesis process. Moreover, microscopic characterization is also required to reliably report the crystal structure and magnetism of these alloys, which adds to the difficulty of research [11,12].

To date, more and more attention has been paid to the application of computational methods in alloy design. Based on first-principles calculations with multiple scattering Korringa–Kohn–Rostoker formalism, Mankovsky et al. [13] demonstrated that the strength of Dzyaloshinskii–Moriya (DM) term was strongly dependent on alloy substitution and epitaxial strain. Density functional theory (DFT) calculations have also been applied to study the electron dynamics in the skyrmion phase of Fe-rich Mn_1−xFe_xGe alloys [14]. However, computational efforts involving DFT have mainly focused on interpreting or extracting properties from the perspective of band theory [14–18]. In fact, the principles of alloy theory and the periodic table offer more avenues for composition design than what has been explored in the literature. For example, Shimono et al. [19] developed the statistical method based on machine learning to predict the chemical categories ideally suitable for creating chiral molecules. This model employs a probabilistic classifier and an artificial neural network, which further enhances the deep learning approach of previous work.

Artificial intelligence combined with deep learning-based statistical techniques can make predictions for novel uncharacterized materials and invent completely new materials [20]. Machine learning can express complex function mappings without the knowledge of structural features, and they form to be an effective estimation technique in the analysis of nonlinear behaviors. Input and output relationship of the system can be predicted through machine learning irrespective of the understanding of detailed mechanisms [9,21]. Previous studies have found that skyrmion is not limited to the magnets with DM interaction, such as B20, but widely exists in magnetic materials, thus requiring the assistance of high-throughput calculation [22–24]. However, there is no effective method to predict the accuracy of chiral crystal formation, and it is even more difficult to predict the coexistence of chiral geometries when multiple atoms are mixed [25,26]. For this kind of high dimensionality problem, the choice of features and classification schemes is crucial to achieving the system with high predictive performance [27–30]. Various logical models have been optimized to find a statistical technique to predict whether a substance is a skyrmion. In this work, machine learning algorithms, such as ensembles of trees, linear regression models, support vector machine (SVM), k-nearest neighbor (KNN), and naive Bayes, are used to analyze the dataset. Their abilities to classify materials were compared, and the model with the highest accuracy of 87.5% was obtained.

Results and Discussion

Less

Data science needs to find an appropriate classification method, especially when the amount of data is limited. The electronic layer, outermost electron number, principal quantum number, and element occurrence frequency, which have great influence on the material properties, were selected as intrinsic features. The difference between electronic layer classification and principal quantum number classification is that the former uses rare earth as an independent group based on the latter. From the accuracy and reliability of the models in Fig. 1, it can be seen that the classification based on the electronic layer works best. For models with poor performance, increasing the number of training sessions or providing more data in model creation may improve accuracy. However, the effect of the model is difficult to be stable, indicating that there is a serious overfitting at this time.

As shown in Table 1, the accuracy and reliability of different algorithms based on electronic layer classification are mostly above 76.3% and 0.72. Compared with other algorithms, the constraint relationship between predictors and target parameters in linear models may lead to lower prediction accuracy, such as logistic regression and linear discriminant. The performance of bagged trees, boosted trees, KNN, and SVM is introduced in detail below. The chemical composition of each material is represented by a linear combination of weighted contributions from these element classes. For example, Fe₃Sn₂ is described as 0.6 × label 3 + 0.4 × label 4. Labels refer to different electronic layers, which can be found in Table 2. Note that the rare earth elements with electronic layers of 6 are included as a separate group to make the model work better.

Bagged trees

We used the bootstrap method to create different samples from the original data and constructed the forest using the independent decision trees generated from each sample [31–34]. The results predicted from bagged trees can reduce overfitting and be more stable due to the differences between bootstrap samples. Compared with traditional decision trees, bagged trees is an integrated model that can solve the problems of poor stability and data fragmentation. As can be seen in Fig. 2A, parallel coordinate plot (PCP) was used to realize the visualization of high-dimensional multivariate data [35]. PCP shows the importance of each label in attribute type and the interrelation between labels. Each vertical line in this figure represents the class of electronic layer, and each sample is shown as a broken line running through all the vertical lines. As one can see, the lines on label 3 are more chaotic. This is because most materials contain elements in label 3, resulting in little influence of this label on the prediction. However, the same types of lines on labels 4 and 6 are concentrated, and the different types of lines are scattered, indicating that these labels are of great help in predicting the skyrmion category.

Figure 2B shows the changes in model accuracy and reliability with the increase of training data. When the training data are around 30, the model effect drops sharply, indicating that the newly added data have an adverse impact on the model. However, this part of data has been well learned with the increase in the number of iterations and the amount of data. The accuracy and reliability are also gradually improved and stabilized. Receiver operating characteristic (ROC) curve based on confusion matrix (Fig. 2C) was used to evaluate the predictive ability. Figure 2D shows the ROC curve obtained after the stabilization of the algorithm, where the abscissa is the false positive rate (FPR) and the ordinate is the true positive rate (TPR). The FPR only has an error of 5%, indicating that the probability of misjudging the material as skyrmion is very small. The accuracy of bagged trees classifier is 82.5%, and the area under ROC curve (AUC) is 0.82. AUC is a comprehensive measure of the effect of all possible classification thresholds and is intended to determine the degree of reliability or the ability to correctly predict categories. AUC ranged from 0.5 to 1, with the higher the better. Bagged trees algorithm relies on many decision trees rather than a single decision tree, which allows the model to leverage the insights of multiple models. However, the increased complexity and randomness of the computational process make bagged trees difficult to interpret. Appropriate classification of bagging during the analysis of material data can make it easier for computers to find correlations between components. Boosted trees and random undersampling (RUS) bagged trees described below are both variations of bagged trees.

Boosted trees and RUS bagged trees

Boosted trees and RUS bagged trees are the most ideal models in this work with high accuracy and AUC value. The bootstrap samples of boosted trees are not randomly selected. When a decision tree is generated, boosted trees algorithm checks it against the entire sample and generates a new decision tree by minimizing the false predictions of all previous trees [32,36]. We use the adaptive boosting algorithm, and the accuracy of forest prediction is constantly improved with the sequential construction of decision trees. The AUC value in Fig. 3A is 0.88, which is higher than the result of bagged trees. Figure 3B evaluates the performance of the classifier by comparing positive (1) or negative (0) skyrmion data categories of the evaluation set with trained prediction categories. The TPR of this algorithm is 97%, which is very suitable for evaluating the performance of classification models. However, there are some defects in false negative prediction, which may be caused by insufficient interference terms in the data. Future improvements can be made by, for example, increasing the sample size to improve the accuracy of the predictions.

As shown in Fig. 3C, bagged trees with RUS has the accuracy and reliability of 87.5% and 0.89, respectively. The number of instances in the majority class was undersampled to solve the problem of class imbalance. It has been reported that the undersampling scheme based on heterogeneous consensus clustering has better prediction performance [37,38]. The importance of each label and how the labels relate to each other were analyzed according to PCP. The attribute value is obtained in the form of standard deviation of true or false skyrmion as depicted in Fig. 3D. The lines and colors on label 3 are mixed, indicating that this attribute is not helpful for the determination of skyrmion category. This is because most magnetic materials contain the elements in label 3, regardless of whether they are skyrmion materials. However, the same color polylines on label 4 to 6 axes are more concentrated, and different colors have certain spacing. Rare earth elements, in particular, have shown a key role in predicting material categories. Previous studies have also found that rare earths are beneficial to the formation of helical magnetic structures and adjustment of magnetic crystal anisotropy due to their strong spin-orbit coupling and high atomic magnetic moment [39–41]. For example, the substitution of Sc³⁺ induced the transformation of hexagonal ferrites from collinear to helical magnetic structures, and skyrmion domains were observed at room temperature without magnetic field. Therefore, rare earth was divided into a separate group for better modeling.

Support vector machine

SVM is a machine learning algorithm, which can handle high-latitude data and adapt to the small dataset, and has also shown its applicability in this project. We use different kernel functions such as linear kernel, cubic kernel, quadratic kernel, and Gaussian kernel to ensure the nonlinear fitting ability of SVM model and reduce the complexity of vector inner product operation. However, it is difficult to adjust parameters and the training speed is slow. Since the model is not prone to overfitting, a better model can be obtained by increasing the training times while increasing the amount and dimension of data. It is found that the SVM with cubic kernel function has the highest accuracy. PCP in Fig. 4 shows that the elements in labels 2 and 6 have a great effect on the formation of skyrmion. The AUC value of cubic SVM is 0.80, which is slightly lower than the result of boosted trees, but still has a good effect. The poor false negative rate indicates that the model lacks understanding of the skyrmion material system. Seow and Ziegler [42] suggested a remedial measure to overcome the underprediction problem. It involves synthetically increasing the proportion of the high-value points using bootstrapping or oversampling so that the relative proportion of the high-value data points becomes large. The environmental engineering problem is at least 30 times larger than the skyrmion dataset. Therefore, experimental validations are still needed to test the underprediction problem and provide feedback for machine learning model improvement.

Weighted KNN

The dataset based on different weighted KNN methods was trained for magnetic domain prediction. Among the medium KNN, cosine KNN, cubic KNN, and weighted KNN algorithms, the last one is considered to be the best option. Other KNN algorithms have relatively low accuracy and weak stability, which are not suitable for machine learning with high-latitude data. As the simplest and most common machine learning method, KNN has a simple principle and better applicability after weighting. Weighted KNN is an improved algorithm on the basis of fine KNN, and its accuracy and reliability are optimized to 82.5% and 0.76, respectively. The PCP in Fig. 5 also shows that label 6 plays an important role in predicting skyrmion categories. Compared with SVM, weighted KNN has slightly lower accuracy, but higher reliability and practicability. It is because the AUC value of SVM is relatively low, which may be due to underfitting and strong randomness caused by insufficient data.

Figure 6 shows the hot spot maps of RUS bagged trees, bagged trees, cubic SVM, weighted KNN, double-layer neural network, and naive Bayes. As we know, there is a restrictive relationship between accuracy and reliability, that is, the higher the accuracy, the lower the reliability. Hot spot map was used to show the combined effect of accuracy and reliability with the number of training data. The lighter the color inside the green box, the better the prediction of the model (the training data outside the green box are too small to be referenced). The area between the black lines shows the product of accuracy and reliability in the corresponding training dataset. It is found that when the 25 to 32 sets of data are added to the training, the color of hot spot map suddenly became darker. That is, these data have a detrimental effect on the models, which is consistent with the results obtained above. This is mainly because these data contain a large number of new elements that were not included in the previous dataset, leading to improper adaptation of the model. However, the accuracy and reliability gradually recover with the increase of data size and training times, indicating that the model has learned this part of data. In contrast, neural network and naive Bayes model in Fig. 6F performed the worst. Such models cannot reduce the dimension of feature space and are insensitive to the strength of different features [43]. Although the uniform color expresses that the reliability of naive Bayes is stable, its accuracy is only about 53.7%, making it difficult to analyze high-dimensional data and find the hidden relationship between data. In the empirical analysis, the conventional deep neural network architectures combined with the weighted functions can improve the prediction performance [44,45].

As can be seen from the confusion matrix in Figs. 2 to 5, our models have a high TPR and are suitable for prediction. Therefore, we can use the models to predict the new skyrmion material. The confidence that Sr(Fe_1−xSc_x)₁₂O₁₉ contains skyrmion in the range of 0.05 to 0.3 is 79%, indicating that it is most likely to be skyrmion material. In addition, La_2/3Ba_1/3MnO₃ alloy, which was not part of the dataset, was taken as a test case to verify the model trained by bagged trees. According to machine learning results under electron layer classification, the probability of the existence of skyrmion domain in LaBaMnO is more than 80%, which indicates that this material most likely contains skyrmion. This conclusion is verified by the micromagnetic and experimental results. The domain structure of LaBaMnO film prepared by pulsed laser deposition under 500 Oe magnetic field is shown in Fig. 7. The corresponding simulation results also show that LaBaMnO can form stable skyrmion domains. This simple, yet powerful, exercise demonstrates the predictive capabilities of trained machine learning models and can be used to rapidly predict the topological properties of previously unexplored alloy compositions.

Conclusion

Less

In this work, the skyrmion database is established on the foundations of machine learning. Machine learning algorithms such as logistic regression, SVM, decision trees, KNN, naive Bayes, and neural network were used to classify and analyze the data. It is found that the number of electronic layers is a suitable intrinsic feature for element classification, and more than 10 models can meet the application conditions. The RUS bagging trees had the best effect, with the accuracy and reliability of 87.5% and 0.89, respectively. The RUS bagging trees show the potential to build reliable machine learning models from small data. The PCPs show that rare earths in label 6, although not abundant in the materials, play an important role in the prediction of skyrmions. The trained machine learning was used to predict the magnetic domain of LaBaMnO, and the possibility of becoming skyrmion material was confirmed by micromagnetic simulation and experiment. Without complex techniques and advanced modalities, reliable results were obtained using only commonly accessible properties, which provide a basis and guidance for the field of auxiliary materials science and crystal design.

Methods

Less

Machine learning can be used in materials science to achieve pre-experimental prediction. In this work, a database of 196 materials, including 64 kinds of skyrmions, was obtained and analyzed according to different classification methods. More data about non-skyrmion could help prevent the occurrence of allergies. Electronic layers, outermost electron number, principal quantum number, and element occurrence frequency were selected as features and applied to classifier. Further probabilistic computation was performed to find out the chance of true or false skyrmion in the input dataset. Taking electron layer classification as an example, as shown in Fig. 8, we divided the elements involved in the materials into 6 labels. The subplot in ith row, jth column of the matrix is a scatterplot of the ith column against the jth column. For instance, row 1 and column 2 in this figure is a scatterplot with label 2 as abscissa and label 1 as ordinate. The subplots along the diagonal are replaced with histogram plots of the data in the corresponding column. The subplot in the first row, first column refers to the data distribution density of label 1, which can be used to investigate the effect of this label on the formation of skyrmion. The closer the value gets to 1, the more elements of this label are present in skyrmion materials. All data are represented by the subplot in row 7 and column 7, and the category of skyrmion is represented by 1 and 0.

Figure 9 shows the procedure of data-driven strategy, and the different machine learning algorithms are listed in Table 3 [31,46,47]. Kernel functions are used to convert the input data from linearly nonseparable to linearly separable. The greater the separation, the better the performance. SVMs use linear, squad, quadratic, and cubic kernels to establish the relationship between the input descriptors and the presence or absence of skyrmion. In addition, the SVM methods of fine Gaussian, medium Gaussian, and coarse Gaussian are also involved [48]. KNN models can preprocess the raw data collected from the data logger, such as removing irrelevant and noisy data from the dataset to improve accuracy [49]. We also use 2 types of ensembles of trees, bagged trees, and boosted trees, which combine similar (or different) algorithms to provide more accurate predictions.

References

Less

Chappert

, Fert

, Van Dau

. The emergence of spin electronics in data storage. Nat Mater. 2007;6:813–823.

Fert

, Cros

, Sampaio

. Skyrmions on the track. Nat Nanotechnol. 2013;8:152.

Cortés-Ortuño

, Wang

, Beg

, Pepper

, Bisotti

M-A

, Carey

, Vousden

, Kluyver

, Hovorka

, Fangohr

, Thermal stability and topological protection of skyrmions in nanotracks. Sci Rep. 2017;7:4060.

Caretta

, Mann

, Büttner

, Ueda

, Pfau

, Günther

, Hessing

, Churikova

, Klose

, Schneider

, et al. Fast current-driven domain walls and small skyrmions in a compensated ferrimagnet. Nat Nanotechnol. 2018;13:1154–1160.

Jonietz

, Muhlbauer

, Pfleiderer

, Neubauer

, Munzer

, Bauer

, Adams

, Georgii

, Boni

, Duine

, et al. Spin transfer torques in MnSi at ultralow current densities. Science. 2010;330:1648–1651.

Woo

, Song

, Zhang

, Zhou

, Ezawa

, Liu

, Finizio

, Raabe

, Lee

, Kim

, et al. Current-driven dynamics and inhibition of the skyrmion Hall effect of ferrimagnetic skyrmions in GdFeCo films. Nat Commun. 2018;9:959.

Aqeel

, Sahliger

, Taniguchi

, Mndl

, Mettus

, Berger

, Bauer

, Garst

, Pfleiderer

, Back

. Microwave spectroscopy of the low-temperature skyrmion State in Cu₂OSeO₃. Phys Rev Lett. 2021;126:017202.

Cui

, Yu

, Shao

, Liu

, Wu

, Nan

, Zhu

, Wu

, Guo

, Chen

, et al. Neel-type elliptical skyrmions in a laterally asymmetric magnetic multilayer. Adv Mater. 2021;33:2006924.

Xue

, Balachandran

, Hogden

, James

, Xue

, Lookman

. Accelerated search for materials with targeted properties by adaptive design. Nat Commun. 2016;7:11241.

10.

Stolt

, Sigelko

, Mathur

, Jin

. Chemical pressure stabilization of the cubic B20 structure in skyrmion hosting Fe_1-xCo_xGe alloys. Chem Mater. 2018;30:1146–1154.

11.

Nagao

, So

, Yoshida

, Isobe

, Hara

, Ishizuka

, Kimoto

. Direct observation and dynamics of spontaneous skyrmion-like magnetic domains in a ferromagnet. Nat Nanotechnol. 2013;8:325–328.

12.

, Sun

, Hsieh

, Chen

, Kakarla

, Deng

, Chu

, Yang

. Observation of skyrmion-like magnetism in magnetic Weyl semimetal Co₃Sn₂S₂. Mater Today Phys. 2020;12:100189.

13.

Mankovsky

, Wimmer

, Polesya

, Ebert

. Composition-dependent magnetic response properties of Mn_1-xFe_xGe alloys. Phys Rev B. 2018;97:024403.

14.

Gayles

, Freimuth

, Schena

, Lani

, Mavropoulos

, Duine

, Blügel

, Sinova

, Mokrousov

. Dzyaloshinskii-Moriya interaction and Hall effects in the skyrmion phase of Mn_1-xFe_xGe. Phys Rev Lett. 2015;115:036602.

15.

Choi

, Lin

, Zhu

. Density functional theory study of skyrmion pinning by atomic defects in MnSi. Phys Rev B. 2016;93:115112.

16.

Zhang

, Wang

, Yang

, Zhang

, Xu

. A First-Principles study on magnetic topological insulator of VBi₂Te₄. Chin J Rare Met. 2021;45(9):1077–1085.

17.

Kanazawa

, Shibata

, Tokura

. Variation of spin–orbit coupling and related properties in skyrmionic system Mn_1-xFe_xGe. New J Phys. 2016;18:045006.

18.

Zhang

, Qiao

, Huang

, Zou

, Liu

, T

, Li

, Dong

, Wang

. In situ exfoliation and Pt deposition of antimonene for formic acid Oxidation via a predominant dehydrogenation pathway. Research. 2020;2020:5487237.

19.

Shimono

, Inoue

, Kurita

, Ichiraku

. Logistic regression analysis for the material design of chiral crystals. Chem Lett. 2018;47:611.

20.

Granda

, Jurczak

. Artificial neural networks for guest chirality classification through supramolecular interactions. Chem Eur J. 2015;20:12368–12372.

21.

Dylla

, Dunn

, Anand

, Jain

, Snyder

. Guidelines for engineering electronic structures in Half-Heusler thermoelectric materials. Research. 2020;2020:6375171.

22.

Liu

, Zhao

, Shen

, Peng

, Zhang

, Hu

, Sun

. Formation mechanism and energy interaction of spontaneous skyrmion in nanodisks. J Magn Magn Mater. 2021;527:167773.

23.

RöBler

, Bogdanov

, Peiderer

. Spontaneous skyrmion ground states in magnetic metals. Nature. 2006;442:797.

24.

Dai

, Wang

, Tao

, Yang

, Ren

, Zhang

. Skyrmion ground state and gyration of skyrmions in magnetic nanodisks without the Dzyaloshinsky-Moriya interaction. Phys Rev B. 2013;88:054403.

25.

Kaubruegger

, Pastori

, Budich

. Chiral topological phases from artificial neural networks. Phys Rev B. 2018;97:195136.

26.

Bourianoff

, Pinna

, Sitte

, Everschor-Sitte

. Potential implementation of reservoir computing models based on magnetic skyrmions. AIP Adv. 2018;8:055602.

27.

Onan

. Biomedical text categorization based on ensemble pruning and optimized topic modelling. Comput Math Method M. 2018;2018:1–22.

28.

Onan

, Korukoğlu

, Bulut

. A hybrid ensemble pruning approach based on consensus clustering and multi-objective evolutionary algorithm for sentiment classification. Inf Process Manag. 2017;53(4):814–833.

29.

Onan

, Korukoğlu

. A feature selection model based on genetic rank aggregation for text sentiment classification. J Inf Sci. 2016;43:25–38.

30.

Onan

. An ensemble scheme based on language function analysis and feature engineering for text genre classification. J Inf Sci. 2018;44:28–47.

31.

Breiman

. Random forests. Mach Learn. 2001;45:5–32.

32.

Dietterich

. An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Mach Learn. 2000;40:139–157.

33.

Criminisi

, Shotton

, Konukoglu

. Decision forests: A unified framework for classification, regression, density estimation, manifold learning and semi-supervised learning. Found Trends Comput Graph Vis. 2012;7:81–227.

34.

Onan

, Korukoğlu

, Bulut

. Ensemble of keyword extraction methods and classifiers in text classification. Expert Syst Appl. 2016;57:232–247.

35.

Inselberg

. The plane with parallel coordinates. Vis Comput. 1985;1:69–91.

36.

Schapire

, Singer

. BoosTexter: A boosting-based system for text categorization. Mach Learn. 2000;39:135–168.

37.

Onan

. Consensus clustering-based undersampling approach to imbalanced learning. Sci Program. 2019;2019:5901087.

38.

Onan

. Two-stage topic extraction model for bibliometric data analysis based on word embeddings and clustering. IEEE Access. 2019;7:145614–145633.

39.

Nakajima

, Kotani

, Harada

, Ishii

, Mori

. Formation mechanisms of magnetic bubbles in an M-type hexaferrite: Role of chirality reversal at domain walls. Phys Rev B. 2016;94:224427.

40.

Kotani

, Harada

, Malac

, Nakajima

, Kurushima

, Mori

. Magnetic textures in a hexaferrite thin film and their response to magnetic fields revealed by phase microscopy. Jpn J Appl Phys. 2019;58:065004.

41.

Hou

, Li

, Liu

, Gao

, Ma

, Zhou

, Peng

, Yan

, Zhang

, Liu

. Emergence of room temperature stable skyrmionic bubbles in the rare earth based REMn₂Ge₂ (RE = Ce, Pr, and Nd) magnets. Mater Today Phys. 2021;17:100341.

42.

Seow

MXC

, Ziegler

. Correcting systematic underprediction of biochemical oxygen demand in support vector regression. J Environ Eng. 2017;143:04017046.

43.

Onan

. Bidirectional convolutional recurrent neural network architecture with group-wise enhancement mechanism for text sentiment classification. J King Saud Univ Comput Inf Sci. 2022;34:2098–2117.

44.

Onan

. Sentiment analysis on product reviews based on weighted word embeddings and deep neural networks. Concurr Comp. 2020;33:e5909.

45.

Onan A. Topic-enriched word embeddings for sarcasm identification. In: Silhavy R, editor. Software engineering methods in intelligent algorithms. CSOC 2019. Advances in Intelligent Systems and Computing. Springer: Cham; 2019; vol. 984; p. 293–304.

46.

Bonaccorso

. Machine learning algorithms: Popular algorithms for data science and machine learning. Birmingham: Packt Publishing; 2018. p. 80–251.

47.

Kissell

. Machine learning techniques. Algorithmic trading methods. United Kingdom: Academic Press; 2021. p. 221–231.

48.

Rasmussen

, Williams

CKI

. Gaussian processes for machine learning. Cambridge: MIT Press; 2005. p. 223–238.

49.

Zeiada

, Dabous

, Hamad

, Al-Ruzouq

, Khalil

. Machine learning for pavement performance modelling in warm climate regions. Arab J Sci Eng. 2020;45:4091–4109.

Appendix

Less

Year 2023 volume 6 Issue 3

PDF

Cite this Article

BibTeX

Article Info

doi: 10.34133/research.0082

Receive Date：2022-09-29
Online Date：2026-10-28
Published：2023-03-20

Article Data

Affiliations

History

Received：2022-09-29
Accepted：2023-02-08

Affiliations

¹Department of Physics, School of Artificial Intelligence, Beijing Technology and Business University, Beijing 100048, P. R. China.

²School of Integrated Circuit Science and Engineering, Beihang University, Beijing 100191, China.

³Ningbo Institute of Materials, Technology & Engineering, Chinese Academy of Sciences, Zhejiang 315201, P. R. China.

⁴School of Physics, Inner Mongolia University of Science and Technology, Baotou 014010, P. R. China.

⁵State Key Laboratory of Magnetism, Institute of Physics, Chinese Academy of Sciences, Beijing 100190, P. R. China.

⁶School of Materials Science and Engineering, Zhejiang University, Hangzhou 310027, P. R. China.

⁷Key Laboratory of Cryogenics, Technical Institute of Physics and Chemistry, Chinese Academy of Sciences, Beijing 100190, P. R. China.

Corresponding:

^* Address correspondence to: liudan@btbu.edu.cn

References

Share

https://castjournals.cast.org.cn/joweb/research/EN/10.34133/research.0082

Share to

Scan QR to access full text

Cite this article

BibTeX

Citations

表12种不同金属材料的力学参数

科 Family	属数 Number of genus	种数 Number of species	占总种数比例 Percentage of total species (%)	属 Genus	种数 Number of species	占总种数比例 Percentage of total species (%)
鹅膏菌科Amanitaceae	2	11	5.26	鹅膏菌属 Amanita	10	4.78
小菇科 Mycenaceae	2	12	5.74	丝盖伞属 Inocybe	5	2.39
多孔菌科 Polyporaceae	8	14	6.70	蜡蘑属 Laccaria	5	2.39
红菇科 Russulaceae	3	23	11.00	小皮伞属 Marasmius	6	2.87
				小菇属 Mycena	11	5.26
				光柄菇属 Pluteus	5	2.39
				红菇属 Russula	17	8.13
				栓菌属 Trametes	5	2.39

关闭全屏

BibTeX
EndNote
RefWorks
TxT

Table 1. Classification accuracy and reliability values for different proposed methods based on electronic layers.

Method	Accuracy	Reliability
RUS bagged trees	87.5%	0.89
Boosted trees	87.4%	0.86
Bagged trees	82.5%	0.82
Weighted KNN	81.3%	0.82
Cubic SVM	83.8%	0.80
Quadratic SVM	82.5%	0.79
Coarse Gaussian SVM	80.0%	0.79
Linear SVM	76.3%	0.78
Squad SVM	82.5%	0.76
Cubic KNN	82.5%	0.76
Subspace discriminant	81.3%	0.75
Logistic regression	83.8%	0.74
Medium KNN	82.5%	0.74
Cosine KNN	81.3%	0.72
Neural network	77.2%	0.75
Linear discriminant	76.5%	0.72
Medium Gaussian SVM	85.0%	0.69
Fine Gaussian SVM	80.0%	0.65
Naive Bayes	53.7%	0.58

Table 2. The elements are divided into labels 1 to 6 according to the principal quantum number.

	Label 1	Label 2	Label 3	Label 4	Label 5	Label 6
Number of electron layers	2	3	4	5	6	6&RE
Elements	B, O, F	Si, Na, Al, Mg, S	Fe, Co, Mn, Ge, Cu, Se, Ga, Ni, Cr, As, Br, Sc, V	Sn, Sr, Cd, Te, Y, Mo, Pd, Te, I	Ta, Bi, Pt, Ba	La, Nd, Gd, Tb, Ho, Er, Yb

Table 3. Machine learning algorithms and corresponding subcategories used for skyrmion prediction in this work.

Algorithm	Subcategory
Linear regression models	Linear discriminant
	Logistic regression
Support vector machines (SVMs)	Linear SVM
	Squad SVM
	Quadratic SVM
	Cubic SVM
	Fine Gaussian SVM
	Medium Gaussian SVM
	Coarse Gaussian SVM
K-nearest neighbor (KNN)	Medium KNN
	Cosine KNN
	Cubic KNN
	Weighted KNN
Ensembles of trees	Bagged trees
	Boosted trees
	RUS bagged trees

Fig. 1. Reliability (A) and accuracy (B) of models under different intrinsic features, such as outermost electron number, electronic layers, principal quantum number, and element distribution frequency. Data points of the same color represent the results of different algorithms using the same classification.

Fig. 2. Model performance obtained after training bagged trees algorithm. (A) Parallel coordinator plot. (B) The accuracy and reliability of the model were calculated as a function of training data. (C) Confusion matrix. (D) ROC curve, which is used to evaluate its predictive ability.

Fig. 3. (A) ROC curve of boosted trees. (B) Confusion matrix of boosted trees. (C) Accuracy and reliability of RUS bagged trees vary with training data. (D) PCP represents the influence of different labels on classification of RUS bagged trees.

Fig. 4. Model performance obtained after training cubic SVM. (A) ROC curve, used to represent TPR against the FPR at various thresholds. (B) Parallel coordinator plot. (C) Accuracy and reliability vary with training data. (D) Confusion matrix.

Fig. 5. Model performance obtained after training weighted KNN. (A) ROC curve, used to represent TPR against the FPR at various thresholds. (B) Parallel coordinator plot. (C) Accuracy and reliability vary with training data. (D) Confusion matrix.

Fig. 6. Hot spot map for different algorithms. (A) RUS bagged trees. (B) Bagged trees. (C) Cubic SVM. (D) Weighted KNN. (E) Double-layer neural network. (F) Naive Bayes. The area between the black lines shows the product of accuracy and reliability at the corresponding training dataset. The performance of models (A) to (F) gets worse progressively.

Fig. 7. (A) Magnetic domain structure of LaBaMnO film in a magnetic field around 3,500 Oe and (B) corresponding simulation results. The in-plane and lateral magnetic moment distributions in the yellow boxes are shown in (C) and (D), respectively.

Fig. 8. Data distribution matrix. The subplot in the ith row, jth column of the figure is a scatterplot of the ith column against the jth column. The subaxes along the diagonal are histogram plots of the corresponding classes.

Fig. 9. Schematic diagram of the process of data-driven strategy using machine learning models.

Articles: Latest Articles; Most Read; Collections

Updates: Events; News; Multimedia

About: About Us

Contact

No. 86 Xueyuan South Road, Haidian District, Beijing

100081

010-62662699(Operation and Technical Support)

qkjq@cast.org.cn

Copyright © 2025 China Association for Science and Technology. All rights reserved. For all open access content, the relevant licensing terms apply.
Sponsored by the Office of the Leading Group for Cybersecurity and Informatization of CAST, and supported by Science and Technology Review Publishing House