ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factor
An outlier detection algorithm based on entropy weight distance and relative density outlier factor was proposed to solve the problem of low accuracy in complex data distribution and high dimensional data sets.Firstly, entropy weight distance was introduced instead of euclidean distance to improve t...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Journal on Communications
2021-09-01
|
| Series: | Tongxin xuebao |
| Subjects: | |
| Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2021152/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841539307672698880 |
|---|---|
| author | Zhongping ZHANG Weixiong LIU Yuting ZHANG Yu DENG Mianxin WEI |
| author_facet | Zhongping ZHANG Weixiong LIU Yuting ZHANG Yu DENG Mianxin WEI |
| author_sort | Zhongping ZHANG |
| collection | DOAJ |
| description | An outlier detection algorithm based on entropy weight distance and relative density outlier factor was proposed to solve the problem of low accuracy in complex data distribution and high dimensional data sets.Firstly, entropy weight distance was introduced instead of euclidean distance to improve the detection accuracy of outliers.Then, the Gaussian kernel density estimation was carried out for the data object based on the concept of natural neighbor.At the same time, relative distance was proposed to describe the degree of the data object deviating from the neighborhood and improve the ability of the algorithm to detect outliers in the low-density region.Finally, the entropy weight distance and relative density outlier factor were proposed to describe the degree of outliers.Experiments with artificial data sets and real data sets show that the proposed algorithm can effectively adapt to various data distributions and outlier detection of high-dimensional data. |
| format | Article |
| id | doaj-art-c0b1f2937d7b49a98bad88d9917a3a3d |
| institution | Kabale University |
| issn | 1000-436X |
| language | zho |
| publishDate | 2021-09-01 |
| publisher | Editorial Department of Journal on Communications |
| record_format | Article |
| series | Tongxin xuebao |
| spelling | doaj-art-c0b1f2937d7b49a98bad88d9917a3a3d2025-01-14T07:22:45ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2021-09-014213314359744747ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factorZhongping ZHANGWeixiong LIUYuting ZHANGYu DENGMianxin WEIAn outlier detection algorithm based on entropy weight distance and relative density outlier factor was proposed to solve the problem of low accuracy in complex data distribution and high dimensional data sets.Firstly, entropy weight distance was introduced instead of euclidean distance to improve the detection accuracy of outliers.Then, the Gaussian kernel density estimation was carried out for the data object based on the concept of natural neighbor.At the same time, relative distance was proposed to describe the degree of the data object deviating from the neighborhood and improve the ability of the algorithm to detect outliers in the low-density region.Finally, the entropy weight distance and relative density outlier factor were proposed to describe the degree of outliers.Experiments with artificial data sets and real data sets show that the proposed algorithm can effectively adapt to various data distributions and outlier detection of high-dimensional data.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2021152/data miningoutlier detectioninformation entropykernel density estimation |
| spellingShingle | Zhongping ZHANG Weixiong LIU Yuting ZHANG Yu DENG Mianxin WEI ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factor Tongxin xuebao data mining outlier detection information entropy kernel density estimation |
| title | ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factor |
| title_full | ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factor |
| title_fullStr | ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factor |
| title_full_unstemmed | ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factor |
| title_short | ERDOF: outlier detection algorithm based on entropy weight distance and relative density outlier factor |
| title_sort | erdof outlier detection algorithm based on entropy weight distance and relative density outlier factor |
| topic | data mining outlier detection information entropy kernel density estimation |
| url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2021152/ |
| work_keys_str_mv | AT zhongpingzhang erdofoutlierdetectionalgorithmbasedonentropyweightdistanceandrelativedensityoutlierfactor AT weixiongliu erdofoutlierdetectionalgorithmbasedonentropyweightdistanceandrelativedensityoutlierfactor AT yutingzhang erdofoutlierdetectionalgorithmbasedonentropyweightdistanceandrelativedensityoutlierfactor AT yudeng erdofoutlierdetectionalgorithmbasedonentropyweightdistanceandrelativedensityoutlierfactor AT mianxinwei erdofoutlierdetectionalgorithmbasedonentropyweightdistanceandrelativedensityoutlierfactor |