A Cube Analytical Mining Framework for Stream Data

Stream data has been one of the most significant data format recently. OLAM(online analytical mining) operation could provide multi-level data views for analysts. However, OLAM operations depend on data aggregation, which is in conflict with the continuous incensement and dynamic nature of stream da...

Full description

Saved in:
Bibliographic Details
Main Authors: Canghong Jin, Zemin Liu, Minghui Wu, Jing Ying
Format: Article
Language:zho
Published: Beijing Xintong Media Co., Ltd 2014-09-01
Series:Dianxin kexue
Subjects:
Online Access:http://www.telecomsci.com/zh/article/doi/10.3969/j.issn.1000-0801.2014.09.009/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Stream data has been one of the most significant data format recently. OLAM(online analytical mining) operation could provide multi-level data views for analysts. However, OLAM operations depend on data aggregation, which is in conflict with the continuous incensement and dynamic nature of stream data. Thus, partial materialized view from stream data directly by typical OLAP approaches cannot be created and all data cells for the limitation of storage cannot be saved. In order to solve the above problems, an advanced sketch based OLAM framework named sketch cube to analyze stream data was proposed. Sketch cube maps a set of attributes to a unique number and stores it in sub-linear data structure, and then builds an inverted index by tiled time window. The precondition of using sketch cube by theoretical analysis was given and the storage efficiency and query performance on mass mobile data corpus was evaluated, which supports requirements of real-time analysis.
ISSN:1000-0801