TTDSP:A Cost-Effective Approach to Tracking Tuple in Data Stream Processing
The traditional data stream processing systems will keep all the tuples in the memory until they have been processed in order to provide reliable tuple processing.Unfortunately,the strategy will take up much memory.To address this issue,a cost-effective approach to tracking tuples-TTDSP was proposed...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Beijing Xintong Media Co., Ltd
2013-10-01
|
| Series: | Dianxin kexue |
| Subjects: | |
| Online Access: | http://www.telecomsci.com/zh/article/doi/10.3969/j.issn.1000-0801.2013.10.010/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | The traditional data stream processing systems will keep all the tuples in the memory until they have been processed in order to provide reliable tuple processing.Unfortunately,the strategy will take up much memory.To address this issue,a cost-effective approach to tracking tuples-TTDSP was proposed.The approach includes three strategies,namely memory allocation strategy,tuple acker selection strategy and checksum updating strategy,which make tuple acker to keep only the XOR checksum not the tuple in memory.Moreover,the tuple acker are load balancing through the improved consistent Hash.The experiments on memory overhead and load balancing show that this approach is able to track and process tuples effectively and reliably. |
|---|---|
| ISSN: | 1000-0801 |