• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Wang, GongMing (Wang, GongMing.) | Qiao, JunFei (Qiao, JunFei.) (学者:乔俊飞) | Bi, Jing (Bi, Jing.) | Li, WenJing (Li, WenJing.) | Zhou, MengChu (Zhou, MengChu.)

收录:

EI Scopus SCIE

摘要:

A deep belief network (DBN) is effective to create a powerful generative model by using training data. However, it is difficult to fast determine its optimal structure given specific applications. In this paper, a growing DBN with transfer learning (TL-GDBN) is proposed to automatically decide its structure size, which can accelerate its learning process and improve model accuracy. First, a basic DBN structure with single hidden layer is initialized and then pretrained, and the learned weight parameters are frozen. Second, TL-GDBN uses TL to transfer the knowledge from the learned weight parameters to newly added neurons and hidden layers, which can achieve a growing structure until the stopping criterion for pretraining is satisfied. Third, the weight parameters derived from pretraining of TL-GDBN are further fine-tuned by using layer-by-layer partial least square regression from top to bottom, which can avoid many problems of traditional backpropagation algorithm-based fine-tuning. Moreover, the convergence analysis of the TL-GDBN is presented. Finally, TL-GDBN is tested on two benchmark data sets and a practical wastewater treatment system. The simulation results show that it has better modeling performance, faster learning speed, and more robust structure than existing models. Note to Practitioners-Transfer learning (TL) aims to improve training effectiveness by transferring knowledge from a source domain to target domain. This paper presents a growing deep belief network (DBN) with TL to improve the training effectiveness and determine the optimal model size. Facing a complex process and real-world workflow, DBN tends to require long time for its successful training. The proposed growing DBN with TL (TL-GDBN) accelerates the learning process by instantaneously transferring the knowledge from a source domain to each new deeper or wider substructure. The experimental results show that the proposed TL-GDBN model has a great potential to deal with complex system, especially the systems with high nonlinearity. As a result, it can be readily applicable to some industrial nonlinear systems.

关键词:

Convergence analysis deep belief network (DBN) growing DBN with transfer learning (TL-GDBN) partial least square regression (PLSR)-based fine-tuning TL

作者机构:

  • [ 1 ] [Wang, GongMing]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 2 ] [Qiao, JunFei]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 3 ] [Li, WenJing]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 4 ] [Wang, GongMing]Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 5 ] [Qiao, JunFei]Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 6 ] [Li, WenJing]Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 7 ] [Bi, Jing]Beijing Univ Technol, Sch Software Engn, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 8 ] [Zhou, MengChu]New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA

通讯作者信息:

  • [Bi, Jing]Beijing Univ Technol, Sch Software Engn, Fac Informat Technol, Beijing 100124, Peoples R China

查看成果更多字段

相关关键词:

来源 :

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING

ISSN: 1545-5955

年份: 2019

期: 2

卷: 16

页码: 874-885

5 . 6 0 0

JCR@2022

ESI学科: ENGINEERING;

ESI高被引阀值:52

被引次数:

WoS核心集被引频次: 98

SCOPUS被引频次: 101

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 2

在线人数/总访问数:473/2899889
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司