• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Zhan, Ke (Zhan, Ke.) | Jiang, Shimiao (Jiang, Shimiao.) | Bai, Yu (Bai, Yu.) | Li, Yi (Li, Yi.) | Liu, Xu (Liu, Xu.) | Xu, Zhuoran (Xu, Zhuoran.)

收录:

EI

摘要:

Eltwise layer is a commonly used structure in the multi-branch deep learning network. In a filter-wise pruning procedure, due to the specific operation of the eltwise layer, all its previous convolutional layers should vote for which filters by index should be pruned. Since only an intersection of the voted filters is pruned, the compression rate is limited. This work proposes a method called Directed-Weighting Group Lasso (DWGL), which enforces an index-wise incremental (directed) coefficient on the filter-level group lasso items, so that the low index filters getting high activation tend to be kept while the high index ones tend to be pruned. When using DWGL, much fewer filters are retained during the voting process and the compression rate can be boosted. The paper test the proposed method on the ResNet series networks. On CIFAR-10, it achieved a 75.34% compression rate on ResNet-56 with a 0.94% error increment, and a 52.06% compression rate on ResNet-20 with a 0.72% error increment. On ImageNet, it achieved a 53% compression rate with ResNet-50 with a 0.6% error increment, speeding up the network by 2.23 times. Furthermore, it achieved a 75% compression rate on ResNet-50 with a 1.2% error increment, speeding up the network by 4 times. © 2019. The copyright of this document resides with its authors.

关键词:

Computer vision Deep learning Errors

作者机构:

  • [ 1 ] [Zhan, Ke]Faculty of Information Technology, Beijing University of Technology, Beijing, China
  • [ 2 ] [Jiang, Shimiao]Alibaba, Inc., No. 10, Furong Street Chaoyang District, Beijing, China
  • [ 3 ] [Bai, Yu]JD.com, Inc., No. 18, Kechuang 11th Street, Yizhuang Economic and Technological Development Zone, Beijing, China
  • [ 4 ] [Li, Yi]JD.com, Inc., No. 18, Kechuang 11th Street, Yizhuang Economic and Technological Development Zone, Beijing, China
  • [ 5 ] [Liu, Xu]JD.com, Inc., No. 18, Kechuang 11th Street, Yizhuang Economic and Technological Development Zone, Beijing, China
  • [ 6 ] [Xu, Zhuoran]JD.com, Inc., No. 18, Kechuang 11th Street, Yizhuang Economic and Technological Development Zone, Beijing, China

通讯作者信息:

电子邮件地址:

查看成果更多字段

相关关键词:

相关文章:

来源 :

年份: 2020

语种: 英文

被引次数:

WoS核心集被引频次: 0

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 2

归属院系:

在线人数/总访问数:4054/2948488
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司