• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Luo, Zhi-Yong (Luo, Zhi-Yong.) | Song, Rou (Song, Rou.)

Indexed by:

EI Scopus PKU CSCD

Abstract:

To improve the performance of new word identification in Chinese word segment, the authors propose an adaptive method for Chinese new word identification based on multi-feature method for offline corpus processing, in which many features, including context-entropy, likelihood ratios, frequency ratio against background corpus and boundary-verification with basic segmentation are introduced to evaluate the candidate words. And all of the features are integrated into an adaptive SVM classifier. Candidate new words are extracted efficiently on PAT-Array with much less space overhead and arbitrary n-gram words can be identified by the method. The results show that the method can run fast upon new word identification and save much memory.

Keyword:

Natural language processing systems Algorithms Computer applications Word processing Computational linguistics

Author Community:

  • [ 1 ] [Luo, Zhi-Yong]College of Computer Science, Beijing University of Technology, Beijing 100022, China
  • [ 2 ] [Luo, Zhi-Yong]Center for Language Information Processing, Beijing Language and Culture University, Beijing 100083, China
  • [ 3 ] [Song, Rou]Center for Language Information Processing, Beijing Language and Culture University, Beijing 100083, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Journal of Beijing University of Technology

ISSN: 0254-0037

Year: 2007

Issue: 7

Volume: 33

Page: 718-725

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:658/5305557
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.