• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Xiao, Shengchen (Xiao, Shengchen.) | ShengqiYang (ShengqiYang.) | He, Jian (He, Jian.) | Huang, Zhangqin (Huang, Zhangqin.) (Scholars:黄樟钦)

Indexed by:

CPCI-S

Abstract:

In this paper, aiming at overcoming the shortcomings of traditional RSJ (Reduce Side Join) algorithm based on MapReduce framework model, an optimized algorithm is proposed to increase the efficiency of the RSJ by using DistributeCache. The idea of Bit-map algorithm is adopted in this algorithm. Specifically, it extracts and compresses the connection attributes of one of the tables to make a "background" data before executing the traditional RSJ algorithm. The algorithm uses DistributeCache to spread it to various nodes. The "background" data is able to filter out the information which is independent from the records in the table, therefore both the network comnmnication and computation cost are decreased, which increases the efficiency of RSJ.

Keyword:

MapReduce Big Data Join Query Processing Hadoop

Author Community:

  • [ 1 ] [Xiao, Shengchen]Beijing Univ Technol, Beijing Adv Innovat Ctr Future Internet Technol, Beijing 100124, Peoples R China
  • [ 2 ] [ShengqiYang]Beijing Univ Technol, Beijing Adv Innovat Ctr Future Internet Technol, Beijing 100124, Peoples R China
  • [ 3 ] [He, Jian]Beijing Univ Technol, Beijing Adv Innovat Ctr Future Internet Technol, Beijing 100124, Peoples R China
  • [ 4 ] [Huang, Zhangqin]Beijing Univ Technol, Beijing Adv Innovat Ctr Future Internet Technol, Beijing 100124, Peoples R China
  • [ 5 ] [Xiao, Shengchen]Beijing Univ Technol, Beijing Engn Res Ctr IoT Software & Syst, Beijing 100124, Peoples R China
  • [ 6 ] [ShengqiYang]Beijing Univ Technol, Beijing Engn Res Ctr IoT Software & Syst, Beijing 100124, Peoples R China
  • [ 7 ] [He, Jian]Beijing Univ Technol, Beijing Engn Res Ctr IoT Software & Syst, Beijing 100124, Peoples R China
  • [ 8 ] [Huang, Zhangqin]Beijing Univ Technol, Beijing Engn Res Ctr IoT Software & Syst, Beijing 100124, Peoples R China

Reprint Author's Address:

  • [Xiao, Shengchen]Beijing Univ Technol, Beijing Adv Innovat Ctr Future Internet Technol, Beijing 100124, Peoples R China;;[Xiao, Shengchen]Beijing Univ Technol, Beijing Engn Res Ctr IoT Software & Syst, Beijing 100124, Peoples R China

Email:

Show more details

Related Keywords:

Related Article:

Source :

PROCEEDINGS OF 2016 2ND INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTERNET OF THINGS (CCIOT)

Year: 2016

Page: 21-24

Language: English

Cited Count:

WoS CC Cited Count: 1

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:1328/5271272
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.