• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Fang, Juan (Fang, Juan.) (学者:方娟) | Sun, Hao (Sun, Hao.) | Zhou, Li-Fu (Zhou, Li-Fu.) | Ren, Xing-Tian (Ren, Xing-Tian.) | Cai, Min (Cai, Min.)

收录:

CPCI-S

摘要:

MapReduce is an effective programming model for analyzing large-scale data. Hadoop-a distributed processing system is widely used nowadays. Improving the task parallelism can be a key point to improve the MapReduce performance in Hadoop. In this paper, we address the problem in two ways. On the one hand we can run the tasks with some dynamic configurations. On the other hand, considering of the difference of tasktracker we use mathematics method to predict the cups' utilization of tasktracker to assign the task. Experimental results on both ways show we can improve the performance in Hadoop by improving the task parallelism.

关键词:

big data dynamic high performance prediction

作者机构:

  • [ 1 ] [Fang, Juan]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 2 ] [Sun, Hao]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 3 ] [Zhou, Li-Fu]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 4 ] [Ren, Xing-Tian]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 5 ] [Cai, Min]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China

通讯作者信息:

  • 方娟

    [Fang, Juan]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China

查看成果更多字段

相关关键词:

来源 :

PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND INFORMATION SYSTEMS

ISSN: 2352-538X

年份: 2016

卷: 52

页码: 275-278

语种: 英文

被引次数:

WoS核心集被引频次: 0

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 2

在线人数/总访问数:592/2899096
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司