• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Yuan, Tongtong (Yuan, Tongtong.) | Li, Zulin (Li, Zulin.) | Liu, Bo (Liu, Bo.) | Tang, Yinan (Tang, Yinan.) | Liu, Yujia (Liu, Yujia.)

收录:

EI Scopus SCIE

摘要:

Structured pruning is a representative model compression technology for convolutional neural networks (CNNs), aiming to prune some less important filters or channels of CNNs. Most recent structured pruning methods have established some criteria to measure the importance of filters, which are mainly based on the magnitude of weights or other parameters in CNNs. However, these judgment criteria lack explainability, and it is insufficient to simply rely on the numerical values of the network parameters to assess the relationship between the channel and the model performance. Moreover, directly utilizing these pruning criteria for global pruning may lead to suboptimal solutions, therefore, it is necessary to complement search algorithms to determine the pruning ratio for each layer. To address these issues, we propose ARPruning (Attention -map -based Ranking Pruning), which reconstructs a new pruning criterion as the importance of the intra-layer channels and further develops a new local neighborhood search algorithm for determining the optimal inter -layer pruning ratio. To measure the relationship between the channel to be pruned and the model performance, we construct an intra-layer channel importance criterion by considering the attention map for each layer. Then, we propose an automatic pruning strategy searching method that can search for the optimal solution effectively and efficiently. By integrating the well -designed pruning criteria and search strategy, our ARPruning can not only maintain high compression rate but also achieve outstanding accuracy. In our work, it is also experimentally concluded that compared with state-of-the-art pruning methods, our ARPruning method is capable of achieving better compression results. The code can be obtained at https://github.com/dozingLee/ARPruning.

关键词:

Image classification Model compression Pruning criteria Search algorithm

作者机构:

  • [ 1 ] [Yuan, Tongtong]Beijing Univ Technol, Beijing, Peoples R China
  • [ 2 ] [Li, Zulin]Beijing Univ Technol, Beijing, Peoples R China
  • [ 3 ] [Liu, Bo]Beijing Univ Technol, Beijing, Peoples R China
  • [ 4 ] [Liu, Yujia]Beijing Univ Technol, Beijing, Peoples R China
  • [ 5 ] [Tang, Yinan]Inspur Elect Informat Ind Co Ltd, Jinan, Peoples R China

通讯作者信息:

  • [Liu, Bo]Beijing Univ Technol, Beijing, Peoples R China;;

电子邮件地址:

查看成果更多字段

相关关键词:

相关文章:

来源 :

NEURAL NETWORKS

ISSN: 0893-6080

年份: 2024

卷: 174

7 . 8 0 0

JCR@2022

被引次数:

WoS核心集被引频次:

SCOPUS被引频次: 6

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 1

归属院系:

在线人数/总访问数:326/4954343
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司