Dynamic K-Nearest-Neighbor with Distance and attribute weighted for classification

Abstract

K-Nearest-Neighbor (KNN) as an important classification method based on closest training examples has been widely used in data mining due to its simplicity, effectiveness, and robustness. However, the class probability estimation, the neighborhood size and the type of distance function confronting KNN may affect its classification accuracy. Many researchers have been focused on improving the accuracy of KNN via distance weighted, attribute weighted, and dynamically selected methods et al. In this paper, we first reviewed some improved algorithms of KNN in three categories mentioned above. Then, we singled out an improved algorithm called dynamic k-nearest-neighbor with distance and attribute weighted, simply DKNDAW. In DKNDAW, we mixed dynamic selected, distance weighted and attribute weighted methods. We experimentally tested our new algorithm in Weka system, using the whole 36 standard UCI data sets which are downloaded from the main website of Weka. In our experiment, we compared it to KNN, WAKNN, KNNDW, KNNDAW, and DKNN. The experimental results show that DKNDAW significantly outperforms KNN, WAKNN, KNNDW, KNNDAW, and DKNN in terms of the classification accuracy.