A distribute Reduce Side Join algorithm - 文章详情页

作者：

Xiao, Shengchen (Xiao, Shengchen.) | Yang, Shengqi (Yang, Shengqi.) | He, Jian (He, Jian.) | Huang, Zhangqin (Huang, Zhangqin.) (学者：黄樟钦)

收录：

EI Scopus

摘要：

In　this　paper,　aiming　at　overcoming　the　shortcomings　of　traditional　RSJ　(Reduce　Side　Join)　algorithm　based　on　MapReduce　framework　model,　an　optimized　algorithm　is　proposed　to　increase　the　efficiency　of　the　RSJ　by　using　DistributeCache.　The　idea　of　Bit-map　algorithm　is　adopted　in　this　algorithm.　Specifically,　it　extracts　and　compresses　the　connection　attributes　of　one　of　the　tables　to　make　a　＇background＇　data　before　executing　the　traditional　RSJ　algorithm.　The　algorithm　uses　DistributeCache　to　spread　it　to　various　nodes.　The　＇background＇　data　is　able　to　filter　out　the　information　which　is　independent　from　the　records　in　the　table,　therefore　both　the　network　communication　and　computation　cost　are　decreased,　which　increases　the　efficiency　of　RSJ.　©　2016　IEEE.

关键词：

Big data Cloud computing Efficiency Internet of things

作者机构：

[ 1 ] [Xiao, Shengchen]Beijing Advanced Innovation Center for Future Internet Technology, Beijing University of Technology, Beijing; 100124, China
[ 2 ] [Xiao, Shengchen]Beijing Engineering Research Center for IoT Software and Systems, Beijing University of Technology, Beijing; 100124, China
[ 3 ] [Yang, Shengqi]Beijing Advanced Innovation Center for Future Internet Technology, Beijing University of Technology, Beijing; 100124, China
[ 4 ] [Yang, Shengqi]Beijing Engineering Research Center for IoT Software and Systems, Beijing University of Technology, Beijing; 100124, China
[ 5 ] [He, Jian]Beijing Advanced Innovation Center for Future Internet Technology, Beijing University of Technology, Beijing; 100124, China
[ 6 ] [He, Jian]Beijing Engineering Research Center for IoT Software and Systems, Beijing University of Technology, Beijing; 100124, China
[ 7 ] [Huang, Zhangqin]Beijing Advanced Innovation Center for Future Internet Technology, Beijing University of Technology, Beijing; 100124, China
[ 8 ] [Huang, Zhangqin]Beijing Engineering Research Center for IoT Software and Systems, Beijing University of Technology, Beijing; 100124, China

通讯作者信息：

电子邮件地址：

查看成果更多字段

成果类型
所属机构

所有年份指定年份从至