• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Wu, Di (Wu, Di.) | Zheng, Shuang (Zheng, Shuang.) | Wang, Quanmin (Wang, Quanmin.)

收录:

EI Scopus

摘要:

Prompt-based pre-trained language models (PLMs) have demonstrated their superior performance on a wide variety of downstream tasks. In particular, the performance of prompt tuning has significantly outperformed traditional fine-tuning in the zero-shot learning and few-shot learning scenarios. The core idea of prompt-tuning is to convert different downstream tasks to mask language modeling problems through prompts, which can bridge the gap between pre-training tasks and downstream tasks for better results. Verbalizer, as an important part of prompt-tuning, can largely determine the final performance of the model, but the design of the Chinese-based verbalizer is yet to be fully explored. In this paper, we propose a method to expand the verbalizer by extracting knowledge from the training set based on a Chinese text classification task. In brief, we first segment the Chinese training set, then filter the words that can express the semantics of the labels by semantic similarity, and finally add them to the verbalizer. Extensive experimental results on multiple text classification datasets show that our approach significantly outperforms ordinary prompt-tuning and outperforms other methods for constructing the verbalizer. © 2023 SPIE.

关键词:

Modeling languages Classification (of information) Computational linguistics Semantics Zero-shot learning Data mining

作者机构:

  • [ 1 ] [Wu, Di]School of Computer Science, Beijing University of Technology, Beijing, China
  • [ 2 ] [Zheng, Shuang]School of Computer Science, Beijing University of Technology, Beijing, China
  • [ 3 ] [Wang, Quanmin]School of Computer Science, Beijing University of Technology, Beijing, China

通讯作者信息:

电子邮件地址:

查看成果更多字段

相关关键词:

相关文章:

来源 :

ISSN: 0277-786X

年份: 2023

卷: 12645

语种: 英文

被引次数:

WoS核心集被引频次:

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 1

归属院系:

在线人数/总访问数:472/4931609
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司