A Classifier Based on K-Nearest Neighbors Using Weighted Summation of Reconstruction Errors
In this paper, a classifier is introduced based on the nearest neighbor classifier and the reconstruction error for data classification. In the proposed method, first, K nearest data points (neighbors) from each category in the training data are calculated for the test data point. Then, the reconstr...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | fas |
| Published: |
Semnan University
2024-04-01
|
| Series: | مجله مدل سازی در مهندسی |
| Subjects: | |
| Online Access: | https://modelling.semnan.ac.ir/article_8365_94db06f7afdc0cf0db3fb7d849247001.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841527721585278976 |
|---|---|
| author | Rassoul Hajizadeh Mohammad Ali Hosseinzadeh |
| author_facet | Rassoul Hajizadeh Mohammad Ali Hosseinzadeh |
| author_sort | Rassoul Hajizadeh |
| collection | DOAJ |
| description | In this paper, a classifier is introduced based on the nearest neighbor classifier and the reconstruction error for data classification. In the proposed method, first, K nearest data points (neighbors) from each category in the training data are calculated for the test data point. Then, the reconstruction of the test data is performed based on different numbers of nearest neighbors (from one to K) in each category, and the reconstruction error is calculated separately for each number of neighbors. In the next step, for each category, the error is calculated as the weighted sum of the errors obtained from all reconstructions. The weight of the reconstruction error is proportional to the number of neighbors involved in it, so the reconstruction error is multiplied by the number of neighbors. Finally, the test data belongs to the category with the lowest overall error. This process allows a combination of K nearest neighbor classifiers to play a role in data classification. In this paper, 10 datasets from the UCR time series database and five datasets from the UCI classification database are used to evaluate the proposed method. The results of these evaluations show that the proposed method significantly improves the performance of the minimum reconstruction error based KNN classifiers, achieving approximately 5% better recognition rate for some K values and an average recognition rate improvement of about 1.6% for all K values (from 2 to 15).. |
| format | Article |
| id | doaj-art-f7de239e0aa141b4a6df452a3b45525f |
| institution | Kabale University |
| issn | 2008-4854 2783-2538 |
| language | fas |
| publishDate | 2024-04-01 |
| publisher | Semnan University |
| record_format | Article |
| series | مجله مدل سازی در مهندسی |
| spelling | doaj-art-f7de239e0aa141b4a6df452a3b45525f2025-01-15T08:14:58ZfasSemnan Universityمجله مدل سازی در مهندسی2008-48542783-25382024-04-012276556810.22075/jme.2023.30380.24378365A Classifier Based on K-Nearest Neighbors Using Weighted Summation of Reconstruction ErrorsRassoul Hajizadeh0Mohammad Ali Hosseinzadeh1Machine Learning and Deep Learning Research Laboratory, Faculty of Engineering Modern Technologies, Amol University of Special Modern Technologies, Amol, IransFaculty of Engineering Modern Technologies, Amol University of Special Modern Technologies, Amol, IranIn this paper, a classifier is introduced based on the nearest neighbor classifier and the reconstruction error for data classification. In the proposed method, first, K nearest data points (neighbors) from each category in the training data are calculated for the test data point. Then, the reconstruction of the test data is performed based on different numbers of nearest neighbors (from one to K) in each category, and the reconstruction error is calculated separately for each number of neighbors. In the next step, for each category, the error is calculated as the weighted sum of the errors obtained from all reconstructions. The weight of the reconstruction error is proportional to the number of neighbors involved in it, so the reconstruction error is multiplied by the number of neighbors. Finally, the test data belongs to the category with the lowest overall error. This process allows a combination of K nearest neighbor classifiers to play a role in data classification. In this paper, 10 datasets from the UCR time series database and five datasets from the UCI classification database are used to evaluate the proposed method. The results of these evaluations show that the proposed method significantly improves the performance of the minimum reconstruction error based KNN classifiers, achieving approximately 5% better recognition rate for some K values and an average recognition rate improvement of about 1.6% for all K values (from 2 to 15)..https://modelling.semnan.ac.ir/article_8365_94db06f7afdc0cf0db3fb7d849247001.pdfclassifierrecognition ratek-nearest neighborslinear reconstructionweighted combination |
| spellingShingle | Rassoul Hajizadeh Mohammad Ali Hosseinzadeh A Classifier Based on K-Nearest Neighbors Using Weighted Summation of Reconstruction Errors مجله مدل سازی در مهندسی classifier recognition rate k-nearest neighbors linear reconstruction weighted combination |
| title | A Classifier Based on K-Nearest Neighbors Using Weighted Summation of Reconstruction Errors |
| title_full | A Classifier Based on K-Nearest Neighbors Using Weighted Summation of Reconstruction Errors |
| title_fullStr | A Classifier Based on K-Nearest Neighbors Using Weighted Summation of Reconstruction Errors |
| title_full_unstemmed | A Classifier Based on K-Nearest Neighbors Using Weighted Summation of Reconstruction Errors |
| title_short | A Classifier Based on K-Nearest Neighbors Using Weighted Summation of Reconstruction Errors |
| title_sort | classifier based on k nearest neighbors using weighted summation of reconstruction errors |
| topic | classifier recognition rate k-nearest neighbors linear reconstruction weighted combination |
| url | https://modelling.semnan.ac.ir/article_8365_94db06f7afdc0cf0db3fb7d849247001.pdf |
| work_keys_str_mv | AT rassoulhajizadeh aclassifierbasedonknearestneighborsusingweightedsummationofreconstructionerrors AT mohammadalihosseinzadeh aclassifierbasedonknearestneighborsusingweightedsummationofreconstructionerrors AT rassoulhajizadeh classifierbasedonknearestneighborsusingweightedsummationofreconstructionerrors AT mohammadalihosseinzadeh classifierbasedonknearestneighborsusingweightedsummationofreconstructionerrors |