Research and practice on working flow engine of big data platform for gaming service
The big data platform for gaming service is based on Hadoop open source technology. With the demand growth of the service operation staff,there are more and more jobs which depend on each other running on the big data platform. A new working flow engine was developed on Zeus to manage and schedule j...
Saved in:
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | zho |
Published: |
Beijing Xintong Media Co., Ltd
2016-02-01
|
Series: | Dianxin kexue |
Subjects: | |
Online Access: | http://www.telecomsci.com/zh/article/doi/10.3969/j.issn.1000-0801.2016.02.019/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Summary: | The big data platform for gaming service is based on Hadoop open source technology. With the demand growth of the service operation staff,there are more and more jobs which depend on each other running on the big data platform. A new working flow engine was developed on Zeus to manage and schedule jobs efficiently. In order to shorten the start time,Zeus task starting process was optimized and multi-threaded start task was achieved. Zeus was also improved to support the Oracle stored procedure. Pipeline technology was used to seamless and efficient sharing and transmission of heterogeneous data sources. |
---|---|
ISSN: | 1000-0801 |