TTDSP:A Cost-Effective Approach to Tracking Tuple in Data Stream Processing
The traditional data stream processing systems will keep all the tuples in the memory until they have been processed in order to provide reliable tuple processing.Unfortunately,the strategy will take up much memory.To address this issue,a cost-effective approach to tracking tuples-TTDSP was proposed...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Beijing Xintong Media Co., Ltd
2013-10-01
|
| Series: | Dianxin kexue |
| Subjects: | |
| Online Access: | http://www.telecomsci.com/zh/article/doi/10.3969/j.issn.1000-0801.2013.10.010/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841529300845592576 |
|---|---|
| author | Huaming Du Peng Zhang Kefu Xu Jianlong Tan Yan Li |
| author_facet | Huaming Du Peng Zhang Kefu Xu Jianlong Tan Yan Li |
| author_sort | Huaming Du |
| collection | DOAJ |
| description | The traditional data stream processing systems will keep all the tuples in the memory until they have been processed in order to provide reliable tuple processing.Unfortunately,the strategy will take up much memory.To address this issue,a cost-effective approach to tracking tuples-TTDSP was proposed.The approach includes three strategies,namely memory allocation strategy,tuple acker selection strategy and checksum updating strategy,which make tuple acker to keep only the XOR checksum not the tuple in memory.Moreover,the tuple acker are load balancing through the improved consistent Hash.The experiments on memory overhead and load balancing show that this approach is able to track and process tuples effectively and reliably. |
| format | Article |
| id | doaj-art-f060329584cd4153be69c1f37e7c7f61 |
| institution | Kabale University |
| issn | 1000-0801 |
| language | zho |
| publishDate | 2013-10-01 |
| publisher | Beijing Xintong Media Co., Ltd |
| record_format | Article |
| series | Dianxin kexue |
| spelling | doaj-art-f060329584cd4153be69c1f37e7c7f612025-01-15T03:21:31ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012013-10-0129495759625963TTDSP:A Cost-Effective Approach to Tracking Tuple in Data Stream ProcessingHuaming DuPeng ZhangKefu XuJianlong TanYan LiThe traditional data stream processing systems will keep all the tuples in the memory until they have been processed in order to provide reliable tuple processing.Unfortunately,the strategy will take up much memory.To address this issue,a cost-effective approach to tracking tuples-TTDSP was proposed.The approach includes three strategies,namely memory allocation strategy,tuple acker selection strategy and checksum updating strategy,which make tuple acker to keep only the XOR checksum not the tuple in memory.Moreover,the tuple acker are load balancing through the improved consistent Hash.The experiments on memory overhead and load balancing show that this approach is able to track and process tuples effectively and reliably.http://www.telecomsci.com/zh/article/doi/10.3969/j.issn.1000-0801.2013.10.010/data stream processingreliability,data streamload balancing |
| spellingShingle | Huaming Du Peng Zhang Kefu Xu Jianlong Tan Yan Li TTDSP:A Cost-Effective Approach to Tracking Tuple in Data Stream Processing Dianxin kexue data stream processing reliability,data stream load balancing |
| title | TTDSP:A Cost-Effective Approach to Tracking Tuple in Data Stream Processing |
| title_full | TTDSP:A Cost-Effective Approach to Tracking Tuple in Data Stream Processing |
| title_fullStr | TTDSP:A Cost-Effective Approach to Tracking Tuple in Data Stream Processing |
| title_full_unstemmed | TTDSP:A Cost-Effective Approach to Tracking Tuple in Data Stream Processing |
| title_short | TTDSP:A Cost-Effective Approach to Tracking Tuple in Data Stream Processing |
| title_sort | ttdsp a cost effective approach to tracking tuple in data stream processing |
| topic | data stream processing reliability,data stream load balancing |
| url | http://www.telecomsci.com/zh/article/doi/10.3969/j.issn.1000-0801.2013.10.010/ |
| work_keys_str_mv | AT huamingdu ttdspacosteffectiveapproachtotrackingtupleindatastreamprocessing AT pengzhang ttdspacosteffectiveapproachtotrackingtupleindatastreamprocessing AT kefuxu ttdspacosteffectiveapproachtotrackingtupleindatastreamprocessing AT jianlongtan ttdspacosteffectiveapproachtotrackingtupleindatastreamprocessing AT yanli ttdspacosteffectiveapproachtotrackingtupleindatastreamprocessing |