收藏切换
Two-Stage Adaptive Ensemble Learning Method for Different Types of Concept Drift
收藏切换
Husheng Guo1, 2, Yang Zhang1, Wenjian Wang1, 2, *
Journal of Computer Research and Development | 2024, 61(7) : 1799 - 1811
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(7): 1799-1811
• Artificial Intelligence •
Two-Stage Adaptive Ensemble Learning Method for Different Types of Concept Drift
Full
Husheng Guo1, 2, Yang Zhang1, Wenjian Wang1, 2, *
Affiliations
  • 1School of Computer and Information Technology , Shanxi University , Taiyuan 030006
  • 2Key Laboratory of Computational Intelligence and Chinese Information Processing ( Shanxi University ), Ministry of Education , Taiyuan 030006
  • born in 1986. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include data mining, machine learning, and computational intelligence

    born in 1999. Master. Her main research interests include streaming data mining and online machine learning

    born in 1968. PhD, professor, PhD supervisor. Distinguished member of CCF. Her main research interests include machine learning, data mining, and computational intelligence

About Author:

born in 1986. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include data mining, machine learning, and computational intelligence

born in 1999. Master. Her main research interests include streaming data mining and online machine learning

born in 1968. PhD, professor, PhD supervisor. Distinguished member of CCF. Her main research interests include machine learning, data mining, and computational intelligence

Published: 2024-07-01 doi: 10.7544/issn1000-1239.202330452
Outline
收藏切换

In the era of big data, there is a large amount of streaming data emerging. Concept drift, as the most typical and difficult problem in streaming data mining, has received increasing attention. Ensemble learning is a common method for handling concept drift in streaming data. However, after drift occurs, learning models often cannot timely respond to the distribution changes of streaming data and cannot effectively handle different types of concept drift, leading to the decrease in model generalization performance. Aiming at this problem, we propose a two-stage adaptive ensemble learning method for different types of concept drift (TAEL). Firstly, the concept drift type is determined by detecting the drift span. Then, based on different drift types, a “filtering-expansion” two-stage sample processing mechanism is proposed to dynamically select appropriate sample processing strategy. Specifically, during the filtering stage, different non-critical sample filters are created for different drift types to extract key samples from historical sample blocks, making the historical data distribution closer to the latest data distribution and improving the effectiveness of the base learners. During the expansion stage, a block-priority sampling method is proposed, which sets an appropriate sampling scale for the drift type and sets the sampling priority according to the size proportion of the class in the current sample block to which the historical key sample belongs. Then, the sampling probability is determined based on the sampling priority, and a subset of key samples is extracted from the historical key sample blocks according to the sampling probability to expand the current sample block. This alleviates the class imbalance phenomenon after sample expansion, solves the underfitting problem of the current base learner and enhances its stability. Experimental results show that the proposed method can timely respond to different concept drift types, accelerate the convergence speed of online ensemble models after drift occurs, and improve the overall generalization performance of the model.

streaming data  /  concept drift  /  ensemble learning  /  drift type  /  filtering stage  /  expansion stage
郭虎升, 张洋, 王文剑. 面向不同类型概念漂移的两阶段自适应集成学习方法. 计算机研究与发展, 2024 , 61 (7) : 1799 -1811 . DOI: 10.7544/issn1000-1239.202330452
Husheng Guo, Yang Zhang, Wenjian Wang. Two-Stage Adaptive Ensemble Learning Method for Different Types of Concept Drift[J]. Journal of Computer Research and Development, 2024 , 61 (7) : 1799 -1811 . DOI: 10.7544/issn1000-1239.202330452
Year 2024 volume 61 Issue 7
79
36
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202330452
  • Receive Date:2023-06-05
  • Online Date:2026-11-17
  • Published:2024-07-01
Article Data
Affiliations
History
  • Received:2023-06-05
  • Revised:2023-10-09
Affiliations
    1School of Computer and Information Technology , Shanxi University , Taiyuan 030006
    2Key Laboratory of Computational Intelligence and Chinese Information Processing ( Shanxi University ), Ministry of Education , Taiyuan 030006
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330452
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT