• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Yu, Hongyang (Yu, Hongyang.) | Zhang, Xinfeng (Zhang, Xinfeng.) | Wang, Yaowei (Wang, Yaowei.) | Huang, Qingming (Huang, Qingming.) | Yin, Baocai (Yin, Baocai.)

Indexed by:

EI Scopus SCIE

Abstract:

Accident detection in surveillance or dashcam videos is a common task in the field of traffic accident analysis by using videos. However, as accidents occur sparsely and randomly in the real world, the data records are more scarce than the training data for standard detection tasks such as object detection or instance detection. Moreover, the limited and diverse accident data makes it more difficult to model the accident pattern for fine-grained accident detection tasks analyzing the accident in detail. Extra prior information should be introduced in the tasks such as the common vision feature which could offer relatively effective information for many vision tasks. The big model could generate the common vision feature by training on abundant data and consuming a lot of computing time and resources. Even though the accident video data is special, the big model could also extract common vision features. Thus, in this paper, we propose to apply knowledge distillation to fine-grained accident detection which analyzes the spatial temporal existence and severity for solving the issues of complex computing (distillation to the small model) and keeping good performance under limited accident data. Knowledge distillation could offer extra general vision feature information from the pre-trained big model. Common knowledge distillation guides the student network to learn the same representations from the teacher network by logit mimicking or feature imitation. However, single-level distillation could only focus on one aspect of mimicking classification logit or deep features. Multiple tasks with different focuses are required for fine-grained accident detection, such as multiple accident classification, temporal-spatial accident region detection, and accident severity estimation. Thus in this paper, multiple-level distillation is proposed for the different modules to generate the unified video feature concerning all the tasks in fine-grained accident detection analysis. The various experimental results on a fine-grained accident detection dataset which provides more detailed annotations of accidents demonstrate that our method could effectively model the video feature for multiple tasks.

Keyword:

knowledge distillation Video accident detection multiple-level distillation fine-grained accident detection

Author Community:

  • [ 1 ] [Yu, Hongyang]Peng Cheng Lab, Shenzhen 518066, Peoples R China
  • [ 2 ] [Wang, Yaowei]Peng Cheng Lab, Shenzhen 518066, Peoples R China
  • [ 3 ] [Yin, Baocai]Peng Cheng Lab, Shenzhen 518066, Peoples R China
  • [ 4 ] [Zhang, Xinfeng]Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 100039, Peoples R China
  • [ 5 ] [Huang, Qingming]Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 100039, Peoples R China
  • [ 6 ] [Yin, Baocai]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China

Reprint Author's Address:

  • [Zhang, Xinfeng]Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 100039, Peoples R China;;

Show more details

Related Keywords:

Source :

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY

ISSN: 1051-8215

Year: 2024

Issue: 6

Volume: 34

Page: 4445-4457

8 . 4 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 3

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

Online/Total:1026/5397861
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.