• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Xiao, Yinlong (Xiao, Yinlong.) | Ji, Zongcheng (Ji, Zongcheng.) | Li, Jianqiang (Li, Jianqiang.) (学者:李建强) | Han, Mei (Han, Mei.)

收录:

EI Scopus SCIE

摘要:

Integrating lexical knowledge in Chinese named entity recognition (NER) has been proven effective. Among the existing methods, Flat-LAttice Transformer (FLAT) has achieved great success in both performance and efficiency. FLAT performs lexical enhancement for each sentence by constructing a flat lattice (i.e., a sequence of tokens including the characters in a sentence and the matched words in a lexicon) and calculating self-attention with a fully-connected structure. However, the different interactions between tokens, which can bring different aspects of semantic information for Chinese NER, cannot be well captured by self-attention with a fully-connected structure. In this paper, we propose a novel Multi-View Transformer (MVT) to effectively capture the different interactions between tokens. We first define four views to capture four different token interaction structures. We then construct a view-aware visible matrix for each view according to the corresponding structure and introduce a view-aware dot-product attention for each view to limit the attention scope by incorporating the corresponding visible matrix. Finally, we design three different MVT variants to fuse the multi-view features at different levels of the Transformer architecture. Experimental results conducted on four public Chinese NER datasets show the effectiveness of the proposed method. Specifically, on the most challenging dataset Weibo, which is in an informal text style, MVT outperforms FLAT in F1 score by 2.56%, and when combined with BERT, MVT outperforms FLAT in F1 score by 3.03%.

关键词:

Context modeling Transformer Transformers Chinese NER Speech processing Semantics lexicon-based Chinese NER Urban areas Bridges Multi-view Rivers multi-view Transformer

作者机构:

  • [ 1 ] [Xiao, Yinlong]Ping Technol, Beijing 100124, Peoples R China
  • [ 2 ] [Ji, Zongcheng]Ping Technol, Beijing 100124, Peoples R China
  • [ 3 ] [Xiao, Yinlong]Beijing Univ Technol, Fac Informat Technol, Beijing 100021, Peoples R China
  • [ 4 ] [Li, Jianqiang]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 5 ] [Han, Mei]PAII Inc, Palo Alto, CA 94306 USA

通讯作者信息:

  • [Ji, Zongcheng]Ping An Technol, Beijing 100027, Peoples R China;;

查看成果更多字段

相关关键词:

相关文章:

来源 :

IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING

ISSN: 2329-9290

年份: 2024

卷: 32

页码: 3656-3668

5 . 4 0 0

JCR@2022

被引次数:

WoS核心集被引频次:

SCOPUS被引频次: 4

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 1

归属院系:

在线人数/总访问数:327/4978080
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司