Large-scale and rapid flow size estimation for improving flow scheduling - 文章详情页

作者：

收录：

EI Scopus

摘要：

To　minimize　Flow　Completion　Time　(FCT),　existing　flow　scheduling　schemes　assume　prior　knowledge　of　accurate　per-flow　information,　eg,　flow　sizes　or　deadlines,　to　achieve　superior　performance.　In　practice,　it　is　hard　to　get　accurate　per-flow　information,　especially　in　multi-tenant　cloud　environments.　Rather　than　such　unrealistic　assumption　(using　accurate　per-flow　information),　this　paper　proposes　a　flow　size　estimation　mechanism　(called　LFE),　which　uses　machine　learning　algorithms　to　learn　and　explore　the　flow　characteristics　or　patterns　from　historical　data.　LFE　can　estimate　the　flow　size　rapidly　without　accurate　per-flow　information.　To　evaluate　the　impact　of　flow　size　estimation　on　flow　scheduling　performance,　we　implement　LFE　in　a　flow-level　simulator　and　test　its　performance　with　KMeans　and　PageRank　workload,　respectively.　Compared　with　FLUX,　the　average　FCT　reduces　13%　at　90%　load.　The　results　show　that　LFE　has　a　better　flow　size　prediction　accuracy　and　can　improve　the　flow　scheduling　performance.　©　2020　IEEE.

关键词：

Scheduling Learning algorithms Machine learning

作者机构：

[ 1 ] [Wang, Su]State Key Laboratory of Networking and Switching Technology, BUPT, China
[ 2 ] [Wang, Su]Beijing Advanced Innovation Center for Future Internet Technology, Beijing, China
[ 3 ] [Wang, Shuo]State Key Laboratory of Networking and Switching Technology, BUPT, China
[ 4 ] [Wang, Shuo]Beijing Advanced Innovation Center for Future Internet Technology, Beijing, China
[ 5 ] [Zhou, Dong]State Key Laboratory of Networking and Switching Technology, BUPT, China
[ 6 ] [Zhou, Dong]Beijing Advanced Innovation Center for Future Internet Technology, Beijing, China
[ 7 ] [Yang, Yiran]State Key Laboratory of Networking and Switching Technology, BUPT, China
[ 8 ] [Yang, Yiran]Beijing Advanced Innovation Center for Future Internet Technology, Beijing, China
[ 9 ] [Zhang, Wenjie]State Key Laboratory of Networking and Switching Technology, BUPT, China
[ 10 ] [Zhang, Wenjie]Beijing Advanced Innovation Center for Future Internet Technology, Beijing, China
[ 11 ] [Huang, Tao]State Key Laboratory of Networking and Switching Technology, BUPT, China
[ 12 ] [Huang, Tao]Beijing Advanced Innovation Center for Future Internet Technology, Beijing, China
[ 13 ] [Huo, Ru]State Key Laboratory of Networking and Switching Technology, BUPT, China
[ 14 ] [Huo, Ru]Beijing University of Technology, Purple Mountain Laboratories, Nanjing, China
[ 15 ] [Huo, Ru]Beijing Advanced Innovation Center for Future Internet Technology, Beijing, China
[ 16 ] [Liu, Yunjie]State Key Laboratory of Networking and Switching Technology, BUPT, China
[ 17 ] [Liu, Yunjie]Beijing Advanced Innovation Center for Future Internet Technology, Beijing, China

通讯作者信息：

[huo, ru]beijing advanced innovation center for future internet technology, beijing, china;;[huo, ru]state key laboratory of networking and switching technology, bupt, china;;[huo, ru]beijing university of technology, purple mountain laboratories, nanjing, china

电子邮件地址：

huoru@bupt.edu.cn

查看成果更多字段

成果类型
所属机构

所有年份指定年份从至