Turkish Journal of Electrical Engineering and Computer Sciences
DOI
10.55730/1300-0632.4016
Abstract
Although the standard k-nearest neighbor (KNN) algorithm has been used widely for classification in many different fields, it suffers from various limitations that abate its classification ability, such as being influenced by the distribution of instances, ignoring distances between the test instance and its neighbors during classification, and building a single/weak learner. This paper proposes a novel algorithm, called stepwise dynamic nearest neighbor (SDNN), which can effectively handle these problems. Instead of using a fixed parameter k like KNN, it uses a dynamic neighborhood strategy according to the data distribution and implements a new voting mechanism, called stepwise voting. Experimental results were conducted on 50 benchmark datasets. The results showed that the proposed SDNN method outperformed the KNN method, KNN variants, and the state-of-the-art methods in terms of accuracy.
Keywords
Machine learning, classification, k-nearest neighbor, majority voting, ensemble learning
First Page
751
Last Page
770
Recommended Citation
KARABAŞ, DENİZ; BİRANT, DERYA; and TAŞER, PELİN YILDIRIM
(2023)
"Stepwise dynamic nearest neighbor (SDNN): a new algorithm for classification,"
Turkish Journal of Electrical Engineering and Computer Sciences: Vol. 31:
No.
5, Article 2.
https://doi.org/10.55730/1300-0632.4016
Available at:
https://journals.tubitak.gov.tr/elektrik/vol31/iss5/2
Included in
Computer Engineering Commons, Computer Sciences Commons, Electrical and Computer Engineering Commons