• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

He, Ziping (He, Ziping.) | Zhu, Qianglin (Zhu, Qianglin.) | Xia, Kewen (Xia, Kewen.) | Ghamisi, Pedram (Ghamisi, Pedram.) | Zu, Baokai (Zu, Baokai.)

收录:

EI Scopus SCIE

摘要:

Transformer has achieved outstanding performance in many fields such as computer vision benefiting from its powerful and efficient modelling ability and long-range feature extraction capability complementary to convolution. However, on the one hand, the lack of CNN's innate inductive biases, such as translation invariance and local sensitivity, makes Transformer require more data for learning. On the other hand, labelled hyperspectral samples are scarce due to the time-consuming and costly annotation task. To this end, we propose a semi-supervised hierarchical Transformer model for HSI classification to improve the classification performance of the Transformer with limited labelled samples. In order to perturb the samples more fully and extensively to improve the model performance, two different data augmentation methods are used to perturb the unlabelled samples, and two sets of augmented samples are obtained respectively. The pseudo-label obtained on the original unlabelled sample is used to simultaneously supervise the augmented sample obtained on this unlabelled sample. Among them, only the pseudo-labels above the threshold are retained. To further improve the model stability and classification accuracy, hierarchical patch embedding is proposed to eliminate the mutual interference between pixels. Extensive experiments on three well-known hyperspectral datasets validate the effectiveness of the proposed semi-supervised Transformer model. The experiments show that the model achieves excellent classification accuracy even when there are only 10 labelled samples in each category, which can effectively improve the classification performance of Transformer under small-scale labelled samples.

关键词:

semi-supervised learning transformer hyperspectral image classification Hierarchical patch embedding

作者机构:

  • [ 1 ] [He, Ziping]Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha, Peoples R China
  • [ 2 ] [Zhu, Qianglin]Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha, Peoples R China
  • [ 3 ] [Xia, Kewen]Hebei Univ Technol, Sch Elect & Informat Engn, Tianjin, Peoples R China
  • [ 4 ] [Ghamisi, Pedram]Helmholtz Inst Freiberg Resource Technol, Helmholtz Zentrum Dresden Rossendorf HZDR, Freiberg, Germany
  • [ 5 ] [Ghamisi, Pedram]Inst Adv Res Artificial Intelligence IARAI, AI4RS artificial intelligence remote sensing, Vienna, Austria
  • [ 6 ] [Zu, Baokai]Beijing Univ Technol, Fac Informat Technol, Beijing, Peoples R China
  • [ 7 ] [He, Ziping]Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China

通讯作者信息:

  • [He, Ziping]Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China

电子邮件地址:

查看成果更多字段

相关关键词:

来源 :

INTERNATIONAL JOURNAL OF REMOTE SENSING

ISSN: 0143-1161

年份: 2024

期: 1

卷: 45

页码: 21-50

3 . 4 0 0

JCR@2022

被引次数:

WoS核心集被引频次: 2

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 1

归属院系:

在线人数/总访问数:519/4950746
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司