Outlier Detection Method of Dam Monitoring Data Based on Robust Estimation and Variable Separation
The original monitoring data of dams is the most important data to grasp the operation behavior of the dams,and the outliers in the data are the focus during the analysis.Outliers are divided into two categories.One category is caused by measurement errors and should be eliminated or supplemented to...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Office of Pearl River
2024-01-01
|
| Series: | Renmin Zhujiang |
| Subjects: | |
| Online Access: | http://www.renminzhujiang.cn/thesisDetails#10.3969/j.issn.1001-9235.2024.03.015 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841530657226883072 |
|---|---|
| author | LIANG Huibin ZHANG Han ZHANG Linsong CAO Yuxin ZHOU Jingren |
| author_facet | LIANG Huibin ZHANG Han ZHANG Linsong CAO Yuxin ZHOU Jingren |
| author_sort | LIANG Huibin |
| collection | DOAJ |
| description | The original monitoring data of dams is the most important data to grasp the operation behavior of the dams,and the outliers in the data are the focus during the analysis.Outliers are divided into two categories.One category is caused by measurement errors and should be eliminated or supplemented to avoid affecting subsequent analysis.The other is caused by structural mutations and should be highly valued.At present,main outlier recognition methods in dam engineering are based on traditional mathematical statistics and do not consider the influence of structural anomalies,which results in low recognition accuracy.Therefore,based on an in-depth study of dam monitoring data and outlier characteristics,this paper first employs robust MM estimation to eliminate the normal influence of internal and external factors and then adopts the residual measured value to eliminate the stable abnormal influence by difference before and after.Finally,according to the minimum value method,outlier identification is conducted on the residual values.The application of the measured dam data proves that the proposed method can identify the measurement outliers more effectively and robustly,and avoid the interference of structural stability anomalies. |
| format | Article |
| id | doaj-art-3850c7bed85b44b589ba7bbdd027c320 |
| institution | Kabale University |
| issn | 1001-9235 |
| language | zho |
| publishDate | 2024-01-01 |
| publisher | Editorial Office of Pearl River |
| record_format | Article |
| series | Renmin Zhujiang |
| spelling | doaj-art-3850c7bed85b44b589ba7bbdd027c3202025-01-15T03:00:34ZzhoEditorial Office of Pearl RiverRenmin Zhujiang1001-92352024-01-014554031975Outlier Detection Method of Dam Monitoring Data Based on Robust Estimation and Variable SeparationLIANG HuibinZHANG HanZHANG LinsongCAO YuxinZHOU JingrenThe original monitoring data of dams is the most important data to grasp the operation behavior of the dams,and the outliers in the data are the focus during the analysis.Outliers are divided into two categories.One category is caused by measurement errors and should be eliminated or supplemented to avoid affecting subsequent analysis.The other is caused by structural mutations and should be highly valued.At present,main outlier recognition methods in dam engineering are based on traditional mathematical statistics and do not consider the influence of structural anomalies,which results in low recognition accuracy.Therefore,based on an in-depth study of dam monitoring data and outlier characteristics,this paper first employs robust MM estimation to eliminate the normal influence of internal and external factors and then adopts the residual measured value to eliminate the stable abnormal influence by difference before and after.Finally,according to the minimum value method,outlier identification is conducted on the residual values.The application of the measured dam data proves that the proposed method can identify the measurement outliers more effectively and robustly,and avoid the interference of structural stability anomalies.http://www.renminzhujiang.cn/thesisDetails#10.3969/j.issn.1001-9235.2024.03.015outlier detectiontime series datarobust estimationdam monitoringvariable separation |
| spellingShingle | LIANG Huibin ZHANG Han ZHANG Linsong CAO Yuxin ZHOU Jingren Outlier Detection Method of Dam Monitoring Data Based on Robust Estimation and Variable Separation Renmin Zhujiang outlier detection time series data robust estimation dam monitoring variable separation |
| title | Outlier Detection Method of Dam Monitoring Data Based on Robust Estimation and Variable Separation |
| title_full | Outlier Detection Method of Dam Monitoring Data Based on Robust Estimation and Variable Separation |
| title_fullStr | Outlier Detection Method of Dam Monitoring Data Based on Robust Estimation and Variable Separation |
| title_full_unstemmed | Outlier Detection Method of Dam Monitoring Data Based on Robust Estimation and Variable Separation |
| title_short | Outlier Detection Method of Dam Monitoring Data Based on Robust Estimation and Variable Separation |
| title_sort | outlier detection method of dam monitoring data based on robust estimation and variable separation |
| topic | outlier detection time series data robust estimation dam monitoring variable separation |
| url | http://www.renminzhujiang.cn/thesisDetails#10.3969/j.issn.1001-9235.2024.03.015 |
| work_keys_str_mv | AT lianghuibin outlierdetectionmethodofdammonitoringdatabasedonrobustestimationandvariableseparation AT zhanghan outlierdetectionmethodofdammonitoringdatabasedonrobustestimationandvariableseparation AT zhanglinsong outlierdetectionmethodofdammonitoringdatabasedonrobustestimationandvariableseparation AT caoyuxin outlierdetectionmethodofdammonitoringdatabasedonrobustestimationandvariableseparation AT zhoujingren outlierdetectionmethodofdammonitoringdatabasedonrobustestimationandvariableseparation |