• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Na, Weicong (Na, Weicong.) | Liu, Ke (Liu, Ke.) (学者:刘克) | Zhang, Wanrong (Zhang, Wanrong.) (学者:张万荣) | Xie, Hongyun (Xie, Hongyun.) | Jin, Dongyue (Jin, Dongyue.)

收录:

CPCI-S

摘要:

Deep neural network techniques are recently recognized as powerful tools in solving complex and challenging modeling problems of microwave components. However, direct training of a fully connected deep neural network with sigmoid functions using the backpropagation (BP) algorithm is difficult because of the vanishing gradient problem. In this paper, we propose a novel deep neural network modeling technique with batch normalization (BN) to address the vanishing gradient problem. BN layers are added before every sigmoid hidden layer of the deep neural network to normalize the inputs of each sigmoid hidden layer with additional scaling and shifting, thus overcoming the vanishing gradient problem. Automated model generation (AMG) algorithm is also utilized to automatically determine the suitable number of BN layers and sigmoid hidden layers during deep neural network training process. This proposed technique is illustrated by two microwave examples.

关键词:

automated model generation batch normalization Deep neural networks microwave modeling

作者机构:

  • [ 1 ] [Na, Weicong]Beijing Univ Technol, Beijing, Peoples R China
  • [ 2 ] [Liu, Ke]Beijing Univ Technol, Beijing, Peoples R China
  • [ 3 ] [Zhang, Wanrong]Beijing Univ Technol, Beijing, Peoples R China
  • [ 4 ] [Xie, Hongyun]Beijing Univ Technol, Beijing, Peoples R China
  • [ 5 ] [Jin, Dongyue]Beijing Univ Technol, Beijing, Peoples R China

通讯作者信息:

  • [Na, Weicong]Beijing Univ Technol, Beijing, Peoples R China

查看成果更多字段

相关关键词:

相关文章:

来源 :

2020 IEEE MTT-S INTERNATIONAL CONFERENCE ON NUMERICAL ELECTROMAGNETIC AND MULTIPHYSICS MODELING AND OPTIMIZATION (NEMO 2020)

年份: 2020

语种: 英文

被引次数:

WoS核心集被引频次: 1

SCOPUS被引频次: 3

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 2

归属院系:

在线人数/总访问数:4538/2964780
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司