Classification of Imbalanced Data Stream: Techniques and Challenges
DOI:
https://doi.org/10.14738/tmlai.92.9964Abstract
As the number of generated data increases every day, this has brought the importance of data mining and knowledge extraction. In traditional data mining, offline status can be used for knowledge extraction. Nevertheless, dealing with stream data mining is different due to continuously arriving data that can be processed at a single scan besides the appearance of concept drift. As the pre-processing stage is critical in knowledge extraction, imbalanced stream data gain significant popularity in the last few years among researchers. Many real-world applications suffer from class imbalance including medical, business, fraud detection and etc. Learning from the supervised model includes classes whether it is binary- or multi-classes. These classes are often imbalance where it is divided into the majority (negative) class and minority (positive) class, which can cause a bias toward the majority class that leads to skew in predictive performance models. Handles imbalance streaming data is mandatory for more accurate and reliable learning models. In this paper, we will present an overview of data stream mining and its tools. Besides, summarize the problem of class imbalance and its different approaches. In addition, researchers will present the popular evaluation metrics and challenges prone from imbalanced streaming data.
References
R. Zhou, S. Lin, and M. Lin, "Design of evaluation system of residents’ tourism quality of tourism area based on fuzzy evaluation," in Ecosystem Assessment and Fuzzy Systems Management: Springer, 2014, pp. 189-197.
T. Mahmud, J. Sikder, and S. Tripura, "Knowledge-based Decision Support System to Select Hospital Location."
C. Caserio, "Knowledge generating decision support systems: managing the trade-off between generating knowledge and supporting decisions," in Information systems: crossroads for organization, management, accounting and engineering: Springer, 2012, pp. 303-311.
H. He and Y. Ma, Imbalanced learning: foundations, algorithms, and applications. John Wiley & Sons, 2013.
B. Krawczyk, L. L. Minku, J. Gama, J. Stefanowski, and M. Woźniak, "Ensemble learning for data stream analysis: A survey," Information Fusion, vol. 37, pp. 132-156, 2017.
C. Widanage et al., "Anomaly detection over streaming data: Indy500 case study," in 2019 IEEE 12th International Conference on Cloud Computing (CLOUD), 2019, pp. 9-16: IEEE.
D. Le-Phuoc, J. X. Parreira, and M. Hauswirth, "Linked stream data processing," in Reasoning Web International Summer School, 2012, pp. 245-289: Springer.
M. M. Gaber, A. Zaslavsky, and S. Krishnaswamy, "Mining data streams: a review," ACM Sigmod Record, vol. 34, no. 2, pp. 18-26, 2005.
R. Jani, N. Bhatt, and C. Shah, "A survey on issues of data stream mining in classification," in International Conference on Information and Communication Technology for Intelligent Systems, 2017, pp. 137-143: Springer.
E. Ikonomovska, S. Loskovska, and D. Gjorgjevik, "A survey of stream data mining," in Proceedings of 8th National Conference with International participation, ETAI, 2007, pp. 19-21.
M. Kholghi and M. Keyvanpour, "An analytical framework for data stream mining techniques based on challenges and requirements," arXiv preprint arXiv:1105.1950, 2011.
S. Ramírez-Gallego, B. Krawczyk, S. García, M. Woźniak, and F. Herrera, "A survey on data preprocessing for data stream mining: Current status and future directions," Neurocomputing, vol. 239, pp. 39-57, 2017.
J. J. Cochran, Informs analytics body of knowledge. John Wiley & Sons, 2018.
G. Mariscal, O. Marban, and C. Fernandez, "A survey of data mining and knowledge discovery process models and methodologies," The Knowledge Engineering Review, vol. 25, no. 2, p. 137, 2010.
Z. Ge, Z. Song, S. X. Ding, and B. Huang, "Data mining and analytics in the process industry: The role of machine learning," Ieee Access, vol. 5, pp. 20590-20616, 2017.
H.-L. Nguyen, Y.-K. Woon, and W.-K. Ng, "A survey on data stream clustering and classification," Knowledge and information systems, vol. 45, no. 3, pp. 535-569, 2015.
S. Laohakiat, S. Phimoltares, and C. Lursinsap, "A clustering algorithm for stream data with LDA-based unsupervised localized dimension reduction," Information Sciences, vol. 381, pp. 104-123, 2017.
A. Zubaroglu and V. Atalay, "Data stream clustering: a review," arXiv preprint arXiv:2007.10781, 2020.
M. Carnein and H. Trautmann, "Optimizing data stream representation: An extensive survey on stream clustering algorithms," Business & Information Systems Engineering, vol. 61, no. 3, pp. 277-297, 2019.
M. M. YACOUB, A. REZK, and M. SENOUSY, "ADAPTIVE CLASSIFICATION IN DATA STREAM MINING," Journal of Theoretical and Applied Information Technology, vol. 98, no. 13, 2020.
G. Casalino, G. Castellano, and C. Mencar, "Data Stream Classification by Dynamic Incremental Semi-Supervised Fuzzy Clustering," International Journal on Artificial Intelligence Tools, vol. 28, no. 08, p. 1960009, 2019.
R. H. Hariri, E. M. Fredericks, and K. M. Bowers, "Uncertainty in big data analytics: survey, opportunities, and challenges," Journal of Big Data, vol. 6, no. 1, p. 44, 2019.
R. S. Barros, D. R. Cabral, P. M. Gonçalves Jr, and S. G. Santos, "RDDM: Reactive drift detection method," Expert Systems with Applications, vol. 90, pp. 344-355, 2017.
M. Lange, A. Koschel, and I. Astrova, "Dealing with Data Streams: Complex Event Processing vs. Data Stream Mining," in International Conference on Computational Science and Its Applications, 2020, pp. 3-14: Springer.
N. R. Pal, E. S. Corchado, L. T. Kóczy, and V. Kreinovich, "Advances in intelligent systems and computing," 2014.
J. Lu, A. Liu, F. Dong, F. Gu, J. Gama, and G. Zhang, "Learning under concept drift: A review," IEEE Transactions on Knowledge and Data Engineering, vol. 31, no. 12, pp. 2346-2363, 2018.
(Nov 20). Apache spark Lightning-fast unified analytics engine. Available: https://spark.apache.org/
scikit-multiflow. ( 2019-2020 ). scikit-multiflow A machine learning package for streaming data in Python. Available: https://scikit-multiflow.github.io/
A. S. Foundation. Apache Storm. Available: http://storm.apache.org/
MOA. (Nov 20). Machine Learning for Data Streams. Available: https://moa.cms.waikato.ac.nz/
(Nov 20). Data Mining: Practical Machine Learning Tools and Techniques. Available: https://waikato.github.io/weka-wiki/citing_weka/
X. Xiaolong, C. Wen, and S. Yanfei, "Over-sampling algorithm for imbalanced data classification," Journal of Systems Engineering and Electronics, vol. 30, no. 6, pp. 1182-1191, 2019.
R. Zhu, Z. Wang, Z. Ma, G. Wang, and J.-H. Xue, "LRID: A new metric of multi-class imbalance degree based on likelihood-ratio test," Pattern Recognition Letters, vol. 116, pp. 36-42, 2018.
S. Fotouhi, S. Asadi, and M. W. Kattan, "A comprehensive data level analysis for cancer diagnosis on imbalanced data," Journal of biomedical informatics, vol. 90, p. 103089, 2019.
C. Huang, Y. Li, C. L. Chen, and X. Tang, "Deep imbalanced learning for face recognition and attribute prediction," IEEE transactions on pattern analysis and machine intelligence, 2019.
J. Zhao and N. Liu, "Semi-supervised Classification Based Mixed Sampling for Imbalanced Data," Open Physics, vol. 17, no. 1, pp. 975-983, 2019.
S. Carta, G. Fenu, D. R. Recupero, and R. Saia, "Fraud detection for E-commerce transactions by employing a prudential Multiple Consensus model," Journal of Information Security and Applications, vol. 46, pp. 13-22, 2019.
G. Tsoumakas and I. Katakis, "Multi-label classification: An overview," International Journal of Data Warehousing and Mining (IJDWM), vol. 3, no. 3, pp. 1-13, 2007.
M. J. Er, R. Venkatesan, and N. Wang, "An online universal classifier for binary, multi-class and multi-label classification," in 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2016, pp. 003701-003706: IEEE.
A. Fernández, S. García, and F. Herrera, "Addressing the classification with imbalanced data: open problems and new challenges on class distribution," in International conference on hybrid artificial intelligence systems, 2011, pp. 1-10: Springer.
N. Japkowicz, "Concept-learning in the presence of between-class and within-class imbalances," in Conference of the Canadian society for computational studies of intelligence, 2001, pp. 67-77: Springer.
A. Fernández, S. García, M. Galar, R. C. Prati, B. Krawczyk, and F. Herrera, Learning from imbalanced data
S. Vluymans, Dealing with imbalanced and weakly labelled data in machine learning using fuzzy and rough set methods. Springer, 2019.
L. G.-A. a. H. N. a. C. A. a. F. Velasco, "GSVM: An SVM for handling imbalanced accuracy between classes inbiclassification problems," Applied Soft Computing, vol. 17, 2014.
J. Klikowski and M. Woźniak, "Employing One-Class SVM Classifier Ensemble for Imbalanced Data Stream Classification," Cham, 2020, pp. 117-127: Springer International Publishing.
P. R. a. S. Jaiyen, "Hybrid ensembles of decision trees and Bayesian network for class imbalance problem," in 2016 8th International Conference on Knowledge and Smart Technology (KST), 2016, pp. 39-42.
C. Lemnaru and R. Potolea, "Imbalanced classification problems: systematic study, issues and best practices," in International Conference on Enterprise Information Systems, 2011, pp. 35-50: Springer.
O. Komori and S. Eguchi, Statistical methods for imbalanced data in ecological and biological studies. Springer, 2019.
M. S. Shelke, P. R. Deshmukh, and V. K. Shandilya, "A review on imbalanced data handling using undersampling and oversampling technique," Int J Recent Trends in Eng & Res, vol. 3, pp. 444-449, 2017.
P. Branco, L. Torgo, and R. P. Ribeiro, "Relevance-based evaluation metrics for multi-class imbalanced domains," in Pacific-Asia Conference on Knowledge Discovery and Data Mining, 2017, pp. 698-710: Springer.
F. Thabtah, S. Hammoud, F. Kamalov, and A. Gonsalves, "Data imbalance in classification: Experimental evaluation," Information Sciences, vol. 513, pp. 429-441, 2020.
M. Hossin and M. Sulaiman, "A review on evaluation metrics for data classification evaluations," International Journal of Data Mining & Knowledge Management Process, vol. 5, no. 2, p. 1, 2015.
M. Bekkar, H. K. Djemaa, and T. A. Alitouche, "Evaluation measures for models assessment over imbalanced data sets," J Inf Eng Appl, vol. 3, no. 10, 2013.
Keel. Knowledge Extraction based on Evolitionary Learning. Available: http://www.keel.es/
UCI. Welcome to the UC Irvine Machine Learning Repository! Available: https://archive.ics.uci.edu/ml/index.php
PROMISE Software Engineering repository Available: http://promise.site.uottawa.ca/SERepository/
Stream-Learn. Available: https://pypi.org/project/stream-learn/
Machine Learning for Data Streams. Available: https://moa.cms.waikato.ac.nz/
Kaggle. Available: https://www.kaggle.com/
M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, "A density-based algorithm for discovering clusters in large spatial databases with noise," in Kdd, 1996, vol. 96, no. 34, pp. 226-231.
M. Koziarski, M. Woźniak, and B. Krawczyk, "Combined Cleaning and Resampling Algorithm for Multi-Class Imbalanced Data with Label Noise," arXiv preprint arXiv:2004.03406, 2020.
A. Hanskunatai, "A new hybrid sampling approach for classification of imbalanced datasets," in 2018 3rd International Conference on Computer and Communication Systems (ICCCS), 2018, pp. 67-71: IEEE.
P. Ksieniewicz, "Undersampled majority class ensemble for highly imbalanced binary classification," in Second International Workshop on Learning with Imbalanced Domains: Theory and Applications, 2018, pp. 82-94.
B. Sun, H. Chen, J. Wang, and H. Xie, "Evolutionary under-sampling based bagging ensemble method for imbalanced data classification," Frontiers of Computer Science, vol. 12, no. 2, pp. 331-350, 2018.
R. Pruengkarn, K. W. Wong, and C. C. Fung, "Imbalanced data classification using complementary fuzzy support vector machine techniques and smote," in 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2017, pp. 978-983: IEEE. 51
B. Bobowska, J. Klikowski, and M. Woźniak, "Imbalanced Data Stream Classification Using Hybrid Data Preprocessing," in Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 2019, pp. 402-413: Springer.
P. Zyblewski, P. Ksieniewicz, and M. Woźniak, "Classifier selection for highly imbalanced data streams with minority driven ensemble," in International Conference on Artificial Intelligence and Soft Computing, 2019, pp. 626-635: Springer.
P. Zyblewski, R. Sabourin, and M. Woźniak, "Data preprocessing and dynamic ensemble selection for imbalanced data stream classification," in Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 2019, pp. 367-379: Springer.
B. Gulowaty and P. Ksieniewicz, "SMOTE Algorithm Variations in Balancing Data Streams," in International Conference on Intelligent Data Engineering and Automated Learning, 2019, pp. 305-312: Springer.
Y. Sun, Z. Wang, H. Li, and Y. Li, "A Novel Ensemble Classification for Data Streams with Class Imbalance and Concept Drift," International Journal of Performability Engineering, vol. 13, no. 6, 2017.
W. Zhang and J. Wang, "A hybrid learning framework for imbalanced stream classification," in 2017 IEEE International Congress on Big Data (BigData Congress), 2017, pp. 480-487: IEEE.
P. Zyblewski, R. Sabourin, and M. Woźniak, "Preprocessed dynamic classifier ensemble selection for highly imbalanced drifted data streams," Information Fusion, vol. 66, pp. 138-154.
S. Ren et al., "Selection-based resampling ensemble algorithm for nonstationary imbalanced stream data learning," Knowledge-Based Systems, vol. 163, pp. 705-722, 2019.
H. Zhang, W. Liu, S. Wang, J. Shan, and Q. Liu, "Resample-based ensemble framework for drifting imbalanced data streams," IEEE Access, vol. 7, pp. 65103-65115, 2019.
Ł. Korycki and B. Krawczyk, "Online Oversampling for Sparsely Labeled Imbalanced and Non-Stationary Data Streams," in 2020 International Joint Conference on Neural Networks (IJCNN), 2020, pp. 1-8: IEEE.
E. Arabmakki, M. Kantardzic, and T. S. Sethi, "RLS-A reduced labeled samples approach for streaming imbalanced data with concept drift," in Proceedings of the 2014 IEEE 15th International Conference on Information Reuse and Integration (IEEE IRI 2014), 2014, pp. 779-786: IEEE.
M. A. A. Abdualrhman and M. Padma, "CD2A: Concept Drift Detection Approach Toward Imbalanced Data Stream," in Emerging Research in Electronics, Computer Science and Technology: Springer, 2019, pp. 597-
J. Montiel, J. Read, A. Bifet, and T. Abdessalem, "Scikit-multiflow: A multi-output streaming framework," The Journal of Machine Learning Research, vol. 19, no. 1, pp. 2915-2914, 2018.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Mashaal

This work is licensed under a Creative Commons Attribution 4.0 International License.