• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Li, Wenjing (Li, Wenjing.) | Wang, Xiaoxiao (Wang, Xiaoxiao.) | Han, Honggui (Han, Honggui.) | Qiao, Junfei (Qiao, Junfei.)

收录:

EI Scopus SCIE

摘要:

As an extensively used model for time series prediction, the Long-Short Term Memory (LSTM) neural network suffers from shortcomings such as high computational cost and large memory requirement, due to its complex structure. To address these problems, a PLS-based pruning algorithm is hereby proposed for a simplified LSTM (PSLSTM). First, a hybrid strategy is designed to simplify the internal structure of LSTM, which combines the structure simplification and parameter reduction for gates. Second, partial least squares (PLS) regression coefficients are used as the metric to evaluate the importance of the memory blocks, and the redundant hidden layer size is pruned by merging unimportant blocks with their most correlated ones. The Backpropagation Through Time (BPTT) algorithm is utilized as the learning algorithm to update the network parameters. Finally, several benchmark and practical datasets for time series prediction are used to evaluate the performance of the proposed PSLSTM. The experimental results demonstrate that the PLS-based pruning algorithm can achieve the trade-off between a good generalization ability and a compact network structure. The computational complexity is improved by the simple internal structure as well as the compact hidden layer size, without sacrificing prediction accuracy. (C) 2022 Elsevier B.V. All rights reserved.

关键词:

Time series prediction Partial least squares (PLS) regression Hidden layer size Pruning algorithm Internal structure simplification

作者机构:

  • [ 1 ] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 2 ] Beijing Artificial Intelligence Inst, Beijing 100124, Peoples R China
  • [ 3 ] Minist Educ, Engn Res Ctr Intelligence Percept & Autonomous Co, Beijing 100124, Peoples R China
  • [ 4 ] Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 5 ] Beijing Lab Intelligent Environm Protect, Beijing 100124, Peoples R China

通讯作者信息:

电子邮件地址:

查看成果更多字段

相关关键词:

来源 :

KNOWLEDGE-BASED SYSTEMS

ISSN: 0950-7051

年份: 2022

卷: 254

8 . 8

JCR@2022

8 . 8 0 0

JCR@2022

ESI学科: COMPUTER SCIENCE;

ESI高被引阀值:46

JCR分区:1

中科院分区:2

被引次数:

WoS核心集被引频次:

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 1

归属院系:

在线人数/总访问数:445/5045318
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司