收藏切换
Semi-Supervised Learning-Based Method for Unknown Anomaly Detection
收藏切换
Yudong Cheng, Fang Zhou*
Journal of Computer Research and Development | 2024, 61(7) : 1670 - 1680
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(7): 1670-1680
• Special Issue on Data-Driven Information System Services •
Semi-Supervised Learning-Based Method for Unknown Anomaly Detection
Full
Yudong Cheng, Fang Zhou*
Affiliations
  • School of Data Science and Engineering, East China Normal University, Shanghai 200062
  • born in 1998. Master. His main research interest includes anomaly detection

    born in 1983. PhD, associate professor. Her main research interests include data mining and machine learning

About Author:

born in 1998. Master. His main research interest includes anomaly detection

born in 1983. PhD, associate professor. Her main research interests include data mining and machine learning

Published: 2024-07-01 doi: 10.7544/issn1000-1239.202330627
Outline
收藏切换

Anomaly detection aims to identify data that deviates from expected behavior patterns. Despite the potential of semi-supervised anomaly detection methods in enhancing detection accuracy by utilizing a limited amount of labeled data as prior knowledge, the labeled anomalies (i.e., seen anomalies) acquired are unlikely to cover all types of anomalies. In real-world scenarios, novel types of anomalies (i.e., unseen anomalies) often emerge, which may exhibit distinct characteristics from the known anomalies, thereby rendering them challenging to detect using existing semi-supervised anomaly detection methods. To address this issue, we propose a semi-supervised unknown anomaly detection (SSUAD) method, aimed at simultaneously identifying both known and unseen anomalies. This method utilizes a closed-set classifier for the classification of known anomalies and normal instances, and an unknown anomaly detector for the detection of unseen anomalies. Moreover, considering the extreme imbalance between anomalies and normal instances in the anomaly detection scenario, we design an effective data augmentation strategy to increase the number of anomaly samples. Experiments are conducted on UNSW-NB15 and KDDCUP99 datasets, as well as a real-world dataset SQB. The results reveal that, compared with existing anomaly detection methods, SSUAD exhibits significant improvement in the anomaly detection performance metrics AUC-ROC and AUC-PR, thereby verifying the effectiveness and reasonableness of the proposed method.

anomaly detection  /  out-of-distribution detection  /  semi-supervised learning  /  unseen anomalies  /  tabular data
程渝栋, 周昉. 基于半监督学习的未知异常检测方法. 计算机研究与发展, 2024 , 61 (7) : 1670 -1680 . DOI: 10.7544/issn1000-1239.202330627
Yudong Cheng, Fang Zhou. Semi-Supervised Learning-Based Method for Unknown Anomaly Detection[J]. Journal of Computer Research and Development, 2024 , 61 (7) : 1670 -1680 . DOI: 10.7544/issn1000-1239.202330627
Year 2024 volume 61 Issue 7
55
23
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202330627
  • Receive Date:2023-07-31
  • Online Date:2026-11-17
  • Published:2024-07-01
Article Data
Affiliations
History
  • Received:2023-07-31
  • Revised:2023-12-07
Affiliations
    School of Data Science and Engineering, East China Normal University, Shanghai 200062
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330627
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT