Practice and application of distributed data quality management system in power enterprise
As the improvement of the enterprise’s informationalization level and the increasing management requirement of enterprise refinement，the demand of data management of enterprise is becoming greater and greater，how to improve the data quality of the enterprise is the key problem needed to be solved. A...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Beijing Xintong Media Co., Ltd
2016-04-01
|
| Series: | Dianxin kexue |
| Subjects: | |
| Online Access: | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2016104/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841529784845205504 |
|---|---|
| author | Yuanning LI Sen LIU Shijun ZHANG Feng CHEN Zhiying WANG |
| author_facet | Yuanning LI Sen LIU Shijun ZHANG Feng CHEN Zhiying WANG |
| author_sort | Yuanning LI |
| collection | DOAJ |
| description | As the improvement of the enterprise’s informationalization level and the increasing management requirement of enterprise refinement，the demand of data management of enterprise is becoming greater and greater，how to improve the data quality of the enterprise is the key problem needed to be solved. Aiming at the challenges of data quality management that the power enterprise faces，some solutions for distributed data quality management were proposed. After researching the system features of data quality，some foreign and domestic cases of big data were analyzed as reference，and a solution based on Hadoop distributed processing framework was given to solve the performance bottleneck of centralized data quality system. Hadoop clustering could dissociate defect data from Oracle and the data would be stored separately on multiple servers of the clustering，which could improve the I/O performance and data analysis performance of the magnetic disk effectively. |
| format | Article |
| id | doaj-art-4401b59ee8f744c4be2e4990f801a48a |
| institution | Kabale University |
| issn | 1000-0801 |
| language | zho |
| publishDate | 2016-04-01 |
| publisher | Beijing Xintong Media Co., Ltd |
| record_format | Article |
| series | Dianxin kexue |
| spelling | doaj-art-4401b59ee8f744c4be2e4990f801a48a2025-01-15T03:15:12ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012016-04-013216917459609764Practice and application of distributed data quality management system in power enterpriseYuanning LISen LIUShijun ZHANGFeng CHENZhiying WANGAs the improvement of the enterprise’s informationalization level and the increasing management requirement of enterprise refinement，the demand of data management of enterprise is becoming greater and greater，how to improve the data quality of the enterprise is the key problem needed to be solved. Aiming at the challenges of data quality management that the power enterprise faces，some solutions for distributed data quality management were proposed. After researching the system features of data quality，some foreign and domestic cases of big data were analyzed as reference，and a solution based on Hadoop distributed processing framework was given to solve the performance bottleneck of centralized data quality system. Hadoop clustering could dissociate defect data from Oracle and the data would be stored separately on multiple servers of the clustering，which could improve the I/O performance and data analysis performance of the magnetic disk effectively.http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2016104/data quality managementdistributedHadoop |
| spellingShingle | Yuanning LI Sen LIU Shijun ZHANG Feng CHEN Zhiying WANG Practice and application of distributed data quality management system in power enterprise Dianxin kexue data quality management distributed Hadoop |
| title | Practice and application of distributed data quality management system in power enterprise |
| title_full | Practice and application of distributed data quality management system in power enterprise |
| title_fullStr | Practice and application of distributed data quality management system in power enterprise |
| title_full_unstemmed | Practice and application of distributed data quality management system in power enterprise |
| title_short | Practice and application of distributed data quality management system in power enterprise |
| title_sort | practice and application of distributed data quality management system in power enterprise |
| topic | data quality management distributed Hadoop |
| url | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2016104/ |
| work_keys_str_mv | AT yuanningli practiceandapplicationofdistributeddataqualitymanagementsysteminpowerenterprise AT senliu practiceandapplicationofdistributeddataqualitymanagementsysteminpowerenterprise AT shijunzhang practiceandapplicationofdistributeddataqualitymanagementsysteminpowerenterprise AT fengchen practiceandapplicationofdistributeddataqualitymanagementsysteminpowerenterprise AT zhiyingwang practiceandapplicationofdistributeddataqualitymanagementsysteminpowerenterprise |