• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Hou, Ying (Hou, Ying.) | Liang, Yi (Liang, Yi.) | Su, Chao (Su, Chao.)

收录:

CPCI-S

摘要:

Streaming data processing has become a hot topic in the big data research. To ensure the timeliness of data processing, it is important to explore the performance-sensitive components in the streaming data processing platform, which can contribute to the more efficient performance optimization. In this paper, we describe the data processing model in the Spark Streaming, the process can be divided into multiple phases. We propose a simple yet useful method to explore performance-sensitive component components among these phases. Experimental results show that the proposed method is suitable for a wide range of workloads. At last, we demonstrate a detail example of the application of this method on the typical Spark Streaming workload Word count and prove its practicability.

关键词:

big data performance-sensitive components spark streaming

作者机构:

  • [ 1 ] [Hou, Ying]Sch Beijing Univ Technol, Beijing 100124, Peoples R China
  • [ 2 ] [Liang, Yi]Sch Beijing Univ Technol, Beijing 100124, Peoples R China
  • [ 3 ] [Su, Chao]Sch Beijing Univ Technol, Beijing 100124, Peoples R China

通讯作者信息:

  • [Hou, Ying]Sch Beijing Univ Technol, Beijing 100124, Peoples R China

查看成果更多字段

相关关键词:

相关文章:

来源 :

PROCEEDINGS OF THE ADVANCES IN MATERIALS, MACHINERY, ELECTRICAL ENGINEERING (AMMEE 2017)

ISSN: 2352-5401

年份: 2017

卷: 114

页码: 390-394

语种: 英文

被引次数:

WoS核心集被引频次: 0

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 3

归属院系:

在线人数/总访问数:154/2900807
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司