Cross-Stream Contrastive Learning for Self-Supervised Skeleton-Based Action Recognition
Ding Li1,2; Yongqiang Tang1; Wensheng Zhang1,2
刊名Image and Vision Computing
2023
期号135页码:15-26
英文摘要

Self-supervised skeleton-based action recognition enjoys a rapid growth alongwith the development of contrastive
learning. The existing methods rely on imposing invariance to augmentations of 3D skeleton within a single
data stream, which merely leverages the easy positive pairs and limits the ability to explore the complicated
movement patterns. In this paper, we advocate that the defect of single-stream contrast and the lack of necessary
feature transformation are responsible for easy positives, and therefore propose a Cross-Stream Contrastive
Learning framework for skeleton-based action Representation learning (CSCLR). Specifically, the proposed
CSCLR not only utilizes intra-stream contrast pairs, but introduces inter-stream contrast pairs as hard samples
to formulate a better representation learning. Besides, to further exploit the potential of positive pairs and increase
the robustness of self-supervised representation learning, we propose a Positive Feature Transformation
(PFT) strategy which adopts feature-level manipulation to increase the variance of positive pairs. To validate
the effectiveness of our method, we conduct extensive experiments on three benchmark datasets NTURGB
+ D 60, NTU-RGB + D 120 and PKU-MMD. Experimental results show that our proposed CSCLR exceeds
the state-of-the-art methods on a diverse range of evaluation protocols.

语种英语
内容类型期刊论文
源URL[http://ir.ia.ac.cn/handle/173211/52223]  
专题精密感知与控制研究中心_人工智能与机器学习
作者单位1.Institute of Automation
2.Univerisity of Chinese Academy of Science
推荐引用方式
GB/T 7714
Ding Li,Yongqiang Tang,Wensheng Zhang. Cross-Stream Contrastive Learning for Self-Supervised Skeleton-Based Action Recognition[J]. Image and Vision Computing,2023(135):15-26.
APA Ding Li,Yongqiang Tang,&Wensheng Zhang.(2023).Cross-Stream Contrastive Learning for Self-Supervised Skeleton-Based Action Recognition.Image and Vision Computing(135),15-26.
MLA Ding Li,et al."Cross-Stream Contrastive Learning for Self-Supervised Skeleton-Based Action Recognition".Image and Vision Computing .135(2023):15-26.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace