• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Jia, Yalu (Jia, Yalu.) | Liu, Lei (Liu, Lei.) | Chen, Hao (Chen, Hao.) | Sun, Yinghong (Sun, Yinghong.)

收录:

Scopus SCIE

摘要:

Unknown word recognition technology is of great significance to improve the precision of text segmentation and syntax analysis. Social network has become an important platform for sharing, disseminating, and acquiring information. Unknown word recognition based on micro-blog short text has become a research hot spot, while the micro-blog text contains a large number of nonstandard terms and network buzzwords, which has increased the difficulty of unknown word recognition. This paper proposes a Chinese unknown word recognition method for micro-blog short text based on improved FP-growth (POS-FP). Firstly, the POS-FP algorithm is used to get frequent itemsets from micro-blog, and the N-grams model is used to filter out unknown words from frequent itemsets. Secondly, the improved mutual information and left-right information entropy are used to verify the internal features of candidate unknown words. Then, context-dependent and open-source methods are used for external verification of candidate unknown words. Compared with traditional methods, this algorithm improves the recognition rate of unknown words in micro-blog short texts.

关键词:

Information entropy FP-growth algorithm Unknown word recognition Mutual information

作者机构:

  • [ 1 ] [Jia, Yalu]Beijing Univ Technol, Coll Appl Sci, Beijing, Peoples R China
  • [ 2 ] [Liu, Lei]Beijing Univ Technol, Coll Appl Sci, Beijing, Peoples R China
  • [ 3 ] [Chen, Hao]Beijing Univ Technol, Coll Appl Sci, Beijing, Peoples R China
  • [ 4 ] [Sun, Yinghong]Beijing Univ Technol, Coll Appl Sci, Beijing, Peoples R China
  • [ 5 ] [Jia, Yalu]Taiji Comp Co Ltd, Beijing, Peoples R China
  • [ 6 ] [Liu, Lei]Beijing Univ Technol, Beijing Inst Sci & Engn Comp, Beijing, Peoples R China
  • [ 7 ] [Chen, Hao]Beijing Univ Technol, Beijing Inst Sci & Engn Comp, Beijing, Peoples R China
  • [ 8 ] [Sun, Yinghong]Beijing Univ Technol, Beijing Inst Sci & Engn Comp, Beijing, Peoples R China

通讯作者信息:

  • [Liu, Lei]Beijing Univ Technol, Coll Appl Sci, Beijing, Peoples R China;;[Liu, Lei]Beijing Univ Technol, Beijing Inst Sci & Engn Comp, Beijing, Peoples R China

电子邮件地址:

查看成果更多字段

相关关键词:

相关文章:

来源 :

PATTERN ANALYSIS AND APPLICATIONS

ISSN: 1433-7541

年份: 2020

期: 2

卷: 23

页码: 1011-1020

3 . 9 0 0

JCR@2022

ESI学科: ENGINEERING;

ESI高被引阀值:115

被引次数:

WoS核心集被引频次: 7

SCOPUS被引频次: 10

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 0

归属院系:

在线人数/总访问数:652/4747638
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司