Review of Literature on Improving the KNN Algorithm

Authors

  • Raja Sakti Arief Daulay Faculty of Computer Science and Information Technology, Universitas Sumatera Utara, Indonesia
  • Syahril Efendi Faculty of Computer Science and Information Technology, Universitas Sumatera Utara, Indonesia
  • Suherman Electrical Engineering Department, Universitas Sumatera Utara, Indonesia

DOI:

https://doi.org/10.14738/tecs.113.14768

Keywords:

K-Nearest Neighbors, machine learning, improve algorithm, classification method, data mining

Abstract

K-Nearest Neighbors (KNN) is a classification algorithm that has been widely used in the world of machine learning. The KNN algorithm classifies objects with learning data that are closest to the object. The special case where the classification is predicted based on the closest learning data is called the Nearest Neighbors algorithm. Classification is an important issue in processing big data, data science, and machine learning. KNN is one of the oldest, simplest, and also accurate algorithms for pattern classification and regression models. Many researchers have also improvised KNNs and the results obtained by these studies have changed a lot in terms of the accuracy of the results. The purpose of this paper is to see the improvement of several types of development of the KNN algorithm.

 

References

L. Wang, “Research and Implementation of Machine Learning Classifier Based on KNN,” in IOP Conference Series: Materials Science and Engineering, 2019.

A. Mehta, D. Goyal, A. Choudhary, B. S. Pabla, and S. Belghith, “Machine Learning-Based Fault Diagnosis of Self-Aligning Bearings for Rotating Machinery Using Infrared Thermography,” Math. Probl. Eng., 2021.

P. Tamrakar and S. P. Syed Ibrahim, “Lazy Learning Associative Classification with WKNN and DWKNN Algorithm,” ITM Web Conf., 2021.

S. Uddin, I. Haque, H. Lu, M. A. Moni, and E. Gide, “Comparative performance analysis of K-Nearest Neighbors (KNN) algorithm and its different variants for disease prediction,” Sci. Rep., 2022.

H. A. Abu Alfeilat et al., “Effects of Distance Measure Choice on K-Nearest Neighbors Classifier Performance: A Review,” Big Data, vol. 7, no. 4, pp. 221–248, 2019.

Z. Pan, Y. Wang, and Y. Pan, “A new locally adaptive k-Nearest Neighbors algorithm based on discrimination class,” Knowledge-Based Syst., vol. 204, p. 106185, 2020.

J. Na, Z. Wang, S. Lv, and Z. Xu, “An Extended K Nearest Neighbors-Based Classifier for Epilepsy Diagnosis,” IEEE Access, 2021.

M. M. R. Khan, R. B. Arif, A. B. Siddique, and M. R. Oishe, “Study and observation of the variation of accuracies of KNN, SVM, LMNN, ENN algorithms on eleven different datasets from UCI machine learning repository,” 4th Int. Conf. Electr. Eng. Inf. Commun. Technol. iCEEiCT 2018, pp. 124–129, 2018.

S. Dong and M. Sarem, “DDoS Attack Detection Method Based on Improved KNN with the Degree of DDoS Attack in Software-Defined Networks,” IEEE Access, vol. 8, pp. 5039–5048, 2020.

Y. An, M. Xu, and C. Shen, “Classification method of teaching resources based on improved KNN algorithm,” Int. J. Emerg. Technol. Learn., vol. 14, no. 4, pp. 73–88, 2019.

Y. Chen et al., “Fast density peak clustering for large scale data based on KNN,” Knowledge-Based Syst., vol. 187, no. xxxx, 2020.

C. Ma and Y. Chi, “KNN Normalized Optimization and Platform Tuning Based on Hadoop,” IEEE Access, 2022.

S. Zhang, “Cost-sensitive KNN classification,” Neurocomputing, vol. 391, pp. 234–242, 2020.

I. F. Kilincer, F. Ertam, and A. Sengur, “Machine learning methods for cyber security intrusion detection: Datasets and comparative study,” Comput. Networks, vol. 188, no. October 2020, p. 107840, 2021.

S. Al-E’mari, M. Anbar, Y. Sanjalawe, S. Manickam, and I. Hasbullah, “Intrusion detection systems using blockchain technology: A review, issues and challenges,” Computer Systems Science and Engineering. 2022.

A. Khraisat, I. Gondal, P. Vamplew, and J. Kamruzzaman, “Survey of intrusion detection systems: techniques, datasets and challenges,” Cybersecurity, 2019.

J. Fu, X. Zhou, and G. Mei, “Internet Digital Economy Development Forecast Based on Artificial Intelligence and SVM-KNN Network Detection,” Comput. Intell. Neurosci., vol. 2022, 2022.

F. Itoo, Meenakshi, and S. Singh, “Comparison and analysis of logistic regression, Naïve Bayes and KNN machine learning algorithms for credit card fraud detection,” Int. J. Inf. Technol., vol. 13, no. 4, pp. 1503–1511, 2021.

T. Zhou et al., “MSIFinder: a python package for detecting MSI status using random forest classifier,” BMC Bioinformatics, 2021.

N. H. Z. Abidin et al., “Improving Intelligent Personality Prediction using Myers-Briggs Type Indicator and Random Forest Classifier,” Int. J. Adv. Comput. Sci. Appl., 2020.

S. Hamsa, Y. Iraqi, I. Shahin, and N. Werghi, “An Enhanced Emotion Recognition Algorithm Using Pitch Correlogram, Deep Sparse Matrix Representation and Random Forest Classifier,” IEEE Access, 2021.

J. Umamaheswari and A. Akila, “An Enhanced Human Speech Emotion Recognition Using Hybrid of PRNN and KNN,” Proc. Int. Conf. Mach. Learn. Big Data, Cloud Parallel Comput. Trends, Perspectives Prospect. Com. 2019, pp. 177–183, 2019.

B. Wang et al., “A Novel Weighted KNN Algorithm Based on RSS Similarity and Position Distance for Wi-Fi Fingerprint Positioning,” IEEE Access, vol. 8, pp. 30591–30602, 2020.

Y. Zhang, G. Cao, B. Wang, and X. Li, “A novel ensemble method for k-Nearest Neighbors,” Pattern Recognit., vol. 85, pp. 13–25, 2019.

N. Ishii, E. Tsuchiya, Y. Bao, and N. Yamaguchi, “Combining classification improvements by ensemble processing,” in Proceedings - Third ACIS International Conference on Software Engineering Research, Management, and Applications, SERA 2005, 2005.

N. F. Rajani, B. Krause, W. Yin, T. Niu, R. Socher, and C. Xiong, “Explaining and Improving Model Behavior with k Nearest Neighbors Representations,” 2020.

L. Chen, C. Wang, J. Chen, Z. Xiang, and X. Hu, “Voice Disorder Identification by using Hilbert-Huang Transform (HHT) and K Nearest Neighbors (KNN),” J. Voice, vol. 35, no. 6, pp. 932.e1-932.e11, 2021.

X. Li, T. Qiao, Y. Pang, H. Zhang, and G. Yan, “A new machine vision real-time detection system for liquid impurities based on dynamic morphological characteristic analysis and machine learning,” Meas. J. Int. Meas. Confed., 2018.

G. Tartarisco et al., “Artificial Intelligence for Dysarthria Assessment in Children with Ataxia: A Hierarchical Approach,” IEEE Access, 2021.

Downloads

Published

2023-06-03

How to Cite

Daulay, R. S. A., Efendi, S., & Suherman. (2023). Review of Literature on Improving the KNN Algorithm. Transactions on Engineering and Computing Sciences, 11(3), 63–72. https://doi.org/10.14738/tecs.113.14768