Motion Boundary Based Sampling and 3D Co-occurrence Descriptors for Action Recognition

	Motion Boundary Based Sampling and 3D Co-occurrence Descriptors for Action Recognition
	Xiaojiang Peng; Yu Qiao; Qiang Peng
刊名	IMAGE AND VISION COMPUTING
	2014
英文摘要	Recent studies witness the success of Bag-of-Features (BoF) frameworks for video based human action recognition. The detection and description of local interest regions are two fundamental problems in BoF framework. In this paper, we propose a motion boundary based sampling strategy and spatial-temporal (3D) co-occurrence descriptors for action video representation and recognition. Our sampling strategy is partly inspired by the recent success of dense trajectory (DT) based features [Wang et al., 2013] for action recognition. Compared with DT, we densely sample spatial-temporal cuboids along a motion boundary which can greatly reduce the number of valid trajectories and preserve the discriminative power. Moreover, we develop a set of 3D cooccurrence descriptors which take account of the spatial-temporal context within local cuboids and deliver rich information for recognition. Furthermore, we decompose each 3D co-occurrence descriptor at pixel level and bin level and integrate the decomposed components with a multi-channel framework, which can improve the performance significantly. To evaluate the proposed methods, we conduct extensive experiments on three benchmarks including KTH, YouTube and HMDB51. The results show that our sampling strategy significantly reduces the computational cost of point tracking without degrading performance. Meanwhile, we achieve superior performance than the state-of-the-art methods. We report 95.6% on KTH, 87.6% on YouTube and 51.8% on HMDB51.
收录类别	SCI
原文出处	http://www.sciencedirect.com/science/article/pii/S0262885614001103
语种	英语
内容类型	期刊论文
源URL	[http://ir.siat.ac.cn:8080/handle/172644/5337]
专题	深圳先进技术研究院_集成所
作者单位	IMAGE AND VISION COMPUTING
推荐引用方式 GB/T 7714	Xiaojiang Peng,Yu Qiao,Qiang Peng. Motion Boundary Based Sampling and 3D Co-occurrence Descriptors for Action Recognition[J]. IMAGE AND VISION COMPUTING,2014.
APA	Xiaojiang Peng,Yu Qiao,&Qiang Peng.(2014).Motion Boundary Based Sampling and 3D Co-occurrence Descriptors for Action Recognition.IMAGE AND VISION COMPUTING.
MLA	Xiaojiang Peng,et al."Motion Boundary Based Sampling and 3D Co-occurrence Descriptors for Action Recognition".IMAGE AND VISION COMPUTING (2014).