Temporal Action Detection with Dynamic Weights Based on Curriculum Learning
Chen YZ(陈云泽)1,2; He jiang1,2; Junrui Xiao1,2; Ding Li1,2; Qingyi Gu2
刊名Neurocomputing
2023
页码106-116
英文摘要

To enable temporal action localization, the computer needs to recognize the locations and classes of action instances in a video. The main challenge to temporal action detection is that the videos are often long and untrimmed, consisting of varying action content. Existing temporal action detection frameworks exhibit a gap between the training and testing phases, which is detrimental to model performance. Specifically, all positive samples are trained identically in the training phase. By contrast, in the testing phase, the positive samples with the best classification and localization scores are selected, while all others are suppressed. To mitigate this issue, we build an auxiliary branch to unify the training and testing procedures. In the construction of the auxiliary branch, we design a dynamic weighting strategy based on curriculum learning, where the weights of training samples are a combination of their classification and localization scores. Motivated by the speculation of curriculum learning, we emphasize the importance of classification and localization scores in different training stages. The classification score accounts for a higher proportion of the combined score in the early stages of the training process. As the epoch increases, the localization score gradually increases in proportion as well. The experimental results demonstrate that our methodology of curriculum-based learning enhances the performance of current action localization techniques. On THUMOS14, our technique outperforms the existing state of-the-art technique (57.6% vs 55.5%). And the performance on ActivityNet v1.3 (mAP@Avg) reaches 35.4%.

语种英语
内容类型期刊论文
源URL[http://ir.ia.ac.cn/handle/173211/52385]  
专题精密感知与控制研究中心_精密感知与控制
作者单位1.School of Artificial Intelligence, University of Chinese Academy of Sciences, Jingjia Road, Huairou District, Beijing, China
2.Institute of Automation, Chinese Academy of Sciences, East Zhongguancun Road, Haidian District, Beijing, China
推荐引用方式
GB/T 7714
Chen YZ,He jiang,Junrui Xiao,et al. Temporal Action Detection with Dynamic Weights Based on Curriculum Learning[J]. Neurocomputing,2023:106-116.
APA Chen YZ,He jiang,Junrui Xiao,Ding Li,&Qingyi Gu.(2023).Temporal Action Detection with Dynamic Weights Based on Curriculum Learning.Neurocomputing,106-116.
MLA Chen YZ,et al."Temporal Action Detection with Dynamic Weights Based on Curriculum Learning".Neurocomputing (2023):106-116.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace