• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Qu, Zhijie (Qu, Zhijie.) | Li, Juan (Li, Juan.) | Ma, Zerui (Ma, Zerui.) | Li, Jianqiang (Li, Jianqiang.)

收录:

CPCI-S EI Scopus

摘要:

Medical dialogue generation relies on natural language generation techniques to enable online medical consultations. Recently, the widespread adoption of large-scale models in the field of natural language processing has facilitated rapid advancements in this technology. Existing medical dialogue models are mostly based on BERT and pre-trained on English corpora, but there is a lack of high-performing models on the task of Chinese medical dialogue generation. To solve the above problem, this paper proposes CMed-GPT, which is the GPT pre-training language model based on Chinese medical domain text. The model is available in two versions, namely, base and large, with corresponding perplexity values of 8.64 and 8.01. Additionally, we incorporate lexical and entity embeddings into the dialogue text in a uniform manner to meet the requirements of downstream dialogue generation tasks. By applying both fine-tuning and p-tuning to CMed-GPT, we lowered the PPL from 8.44 to 7.35. This study not only confirms the exceptional performance of the CMed-GPT model in generating Chinese biomedical text but also highlights the advantages of p-tuning over traditional fine-tuning with prefix prompts. Furthermore, we validate the significance of incorporating external information inmedical dialogue generation, which enhances the quality of dialogue generation.

关键词:

Chinese medical dialogue P-tuning Pre-trained language model

作者机构:

  • [ 1 ] [Qu, Zhijie]Beijing Univ Technol, Beijing 100124, Peoples R China
  • [ 2 ] [Li, Juan]Beijing Univ Technol, Beijing 100124, Peoples R China
  • [ 3 ] [Ma, Zerui]Beijing Univ Technol, Beijing 100124, Peoples R China
  • [ 4 ] [Li, Jianqiang]Beijing Univ Technol, Beijing 100124, Peoples R China

通讯作者信息:

  • [Qu, Zhijie]Beijing Univ Technol, Beijing 100124, Peoples R China;;

电子邮件地址:

查看成果更多字段

相关关键词:

来源 :

ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT II, PAKDD 2024

ISSN: 2945-9133

年份: 2024

卷: 14646

页码: 81-92

被引次数:

WoS核心集被引频次:

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 1

归属院系:

在线人数/总访问数:505/4931884
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司