Amalgamation of Unsupervised and Supervised Approaches for Data Labeling

Authors

  • Sharanjit Kaur Department of Computer Science, Acharya Narendra Dev College, University of Delhi, Delhi, India
  • Meenu Mohil Department of Physics, Acharya Narendra Dev College, University of Delhi, Delhi, India
  • Ansh Sharma Department of Computer Science, Acharya Narendra Dev College, University of Delhi, Delhi, India
  • Hardik Bhaniya Department of Computer Science, Acharya Narendra Dev College, University of Delhi, Delhi, India
  • Harshita Singh Department of Computer Science, Acharya Narendra Dev College, University of Delhi, Delhi, India
  • Manju Bhardwaj Department of Computer Science, Maitreyi College, University of Delhi, Delhi, India

DOI:

https://doi.org/10.14738/tmlai.1305.19355

Abstract

Data abundance is inevitable when every human activity is revolving around Internet of Things (IoT). The data is extensive, but it lacks the labels needed by the machine learning models to identify patterns and characteristics for accurate prediction and automation. Data labeling is a very crucial and essential task for consuming this abundant data for applications like customer relationship management systems, recommendation systems and pattern recognition. We propose a novel approach called  Amalgamation of Unsupervised and Supervised Approaches for Data Labeling (AUSL), which integrates clustering and classification using rule-based refinement. Given the unlabeled data, AUSL offers a robust and interpretable framework for uncovering meaningful data labels. Ensemble-based clustering and AdaBoost SVM ameliorates the selection of important attributes for data labeling, which are further processed by association rule mining to extract underlying significant data characteristics from the reduced domain. Experiments are conducted on four data sets to prove the robustness of the proposed method. The comparative performance of AUSL with an existing method is promising, achieving finer labels with an average hit rate exceeding 90% and confidence levels above 80%. These results indicate the robustness, adaptability, and superior label refinement ability of the proposed method. In conclusion, AUSL provides a scalable, interpretable, and effective solution for structured data labelling, with strong potential for real-world deployment in various data-driven applications.

References

Sun Y, Lank E, Terry M. Label-and-learn: Visualizing the likelihood of machine learning classifier's success during data labeling. In Proceedings of the 22nd International Conference on Intelligent User Interfaces 2017 Mar 7 (pp. 523-534).

Chavez T, Zhao Z, Jiang R, Koepp W, McReynolds D, Zwart PH, Allan DB, Gann EH, Schwarz N, Ushizima D, Barnard ES. A machine-learning-driven data labeling pipeline for scientific analysis in MLExchange. Applied Crystallography. 2025 Jun 1;58(3).

Willemink MJ, Koszek WA, Hardell C, Wu J, Fleischmann D, Harvey H, Folio LR, Summers RM, Rubin DL, Lungren MP. Preparing medical imaging data for machine learning. Radiology. 2020 Apr;295(1):4-15.

Zhang S, Jafari O, Nagarkar P. A survey on machine learning techniques for auto labeling of video, audio, and text data. arXiv preprint arXiv:2109.03784. 2021 Sep 8.

Wang P, Vasconcelos N. Towards professional level crowd annotation of expert domain data. Proc IEEE CVPR. 2023;3166–3175.

Fredriksson T, Mattos DI, Bosch J, Holmström Olsson H. Data labeling: An empirical investigation into industrial challenges and mitigation strategies. In: Morisio M, Torchiano M, Jedlitschka A, editors. Product-Focused Software Process Improvement. Cham: Springer International Publishing; 2020. p. 202–216.

Chegini M, Bernard J, Berger P, Sourin A, Andrews K, Schreck T. Interactive labeling of a multivariate dataset for supervised machine learning using linked visualisations, clustering, and active learning. Visual Informatics. 2019;3(1):9–17.

Beil D, Theissler A. Cluster-clean-label: An interactive machine learning approach for labeling highdimensional data. In: Proceedings of the 13th International Symposium on Visual Information Communication and Interaction. ACM; 2020.

Lopes LA, Machado VP, Rabêlo RAL, Fernandes RA, Lima BV. Automatic labeling of clusters of discrete and continuous data with supervised machine learning. Knowledge-Based Systems. 2016;106:231–241.

Jain AK. Data clustering: 50 years beyond k-means. Pattern Recogn Lett. 2010;31(8):651–666.

Wasilewski A. Customer segmentation in e-commerce: A context-aware quality model for comparing clustering algorithms. Journal of Internet Services and Applications. 2024 Jul 25;15(1):160-78.

Tohalino JV, Amancio DR. Extractive multi-document summarization using multilayer networks. Physica A. 2018;503:526–539.

Aziz NAM, Ali AA, Naguib SM, Fayed L. Clustering-based topic modeling for biomedical documents extractive text summarization. J Supercomput. 2025;81(1):171.

Peganova I, Rebrova A, Nedumov Y. Labeling hierarchical clusters of scientific articles. In: 2019 Ivannikov memorial workshop. IEEE; 2019. p. 26–32.

Cozzolino I, Ferraro MB. Document clustering. Wiley Interdiscip Rev Comput Stat. 2022;14(6):e1588.

Vădineanu S, Pelt DM, Dzyubachyk O, Batenburg KJ. Reducing manual annotation costs for cell segmentation by upgrading low-quality annotations. Journal of Imaging. 2024 Jul 17;10(7):172.

Fredriksson T, Bosch J, Olsson HH. Machine learning models for automatic labeling: A systematic literature review. In: 15th Int Conf on Softw Technologies ICSOFT. SciTePress; 2020. p. 552–561.

Dol SM, Jawandhiya PM. Classification technique and its combination with clustering and association rule mining in educational data mining—a survey. Eng A. 2023;122:106071. 66

Najafabadi MN, Mahrin NM, Chuprat S, Sarkan HM. Improving the accuracy of collaborative filtering recommendations using clustering and association rules mining on implicit data. Comput Human Behav. 2017;67:113–128.

Strehl A, Ghosh J. Cluster ensembles—a knowledge reuse framework for combining multiple partitions. J Mach Learn Res. 2002;3(Dec):583–617.

Bhatnagar V, Ahuja S, Kaur S. Discriminant analysis-based cluster ensemble. Int J Data Min, Mod Manag. 2015;7(2):83–107.

Mehmood Z, Asghar S. Customizing SVM as a base learner with adaboost ensemble to learn from multiclass problems: A hybrid approach adaboost-msvm. Knowl Based Syst. 2021;217:106845.

Silva ALMLS, Neres FJOD, Mendes APSdS, Machado VP, Santana AM, Rabêlo RAL. Method for inferring the number of clusters based on a range of attribute values with subsequent automatic data labeling. Proc Comput Sci. 2023;222:561–570.

Esmaeili SA, Duppala S, Dickerson JP, Brubach B. Fair labeled clustering. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining 2022 Aug 14 (pp. 327-335).

Kennedy RK, Villanustre F, Khoshgoftaar TM, Salekshahrezaee Z. Synthesizing class labels for highly imbalanced credit card fraud detection data. Journal of Big Data. 2024 Mar 9;11(1):38.

Kaya MF. Pattern labeling of business communication data. Group Decision and Negotiation. 2022 Dec;31(6):1203-34.

Zhang X, Ge Y, Qiao Y, Li H. Refining pseudo labels with clustering consensus over generations for unsupervised object re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2021 (pp. 3436-3445).

Lin, Yutian, et al. "A bottom-up clustering approach to unsupervised person reidentification." Proceedings of the AAAI conference on artificial intelligence. Vol. 33. No. 01. 2019.

Zhang H, Peng Y. Image clustering: An unsupervised approach to categorize visual data in social science research. Sociological Methods & Research. 2024 Aug;53(3):1534-87.

Chelebian E, Avenel C, Ciompi F, Wählby C. DEPICTER: Deep representation clustering for histology annotation. Computers in Biology and Medicine. 2024 Mar 1;170:108026.

Golalipour K, Akbari E, Hamidi SS, Lee M, Enayatifar R. From clustering to clustering ensemble selection: A review. Engineering Applications of Artificial Intelligence. 2021 Sep 1;104:104388.

Kumbhare TA, Chobe SV. An overview of association rule mining algorithms. Int J Comput Sci Info Technol. 2014;5(1):927–930.

Kelly M, Longjohn R, Nottingham K. The UCI Machine Learning Repository, https://archive.ics.uci.eduAsuncion A, last accessed: May 2025.

Geng L, Hamilton HJ. Interestingness measures for data mining: A survey. ACM Comput Surv. 2006;38(3):9–es.

Fletcher S, Islam Z, et al. Comparing sets of patterns with the Jaccard index. Australasian J Inf Syst. 2018;22.

Wilson A, Anwar MR. The Future of Adaptive Machine Learning Algorithms in High-Dimensional Data Processing. International Transactions on Artificial Intelligence. 2024 Nov 22;3(1):97-107.

Downloads

Published

2025-09-10

How to Cite

Kaur, S., Mohil, M., Sharma, A., Bhaniya, H., Singh, H., & Bhardwaj, M. (2025). Amalgamation of Unsupervised and Supervised Approaches for Data Labeling. Transactions on Engineering and Computing Sciences, 13(05), 54–67. https://doi.org/10.14738/tmlai.1305.19355