Temporal Upsampling of Depth Maps Using a Hybrid Camera

doi:10.1109/TVCG.2018.2812879

CORC > 计算技术研究所 > 中国科学院计算技术研究所 > 中国科学院计算技术研究所期刊论文 > 英文

	Temporal Upsampling of Depth Maps Using a Hybrid Camera
	Yuan, Ming-Ze 2,3; Xia, Shihong 3; Fu, Hongbo 1; Gao, Lin 3
刊名	IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
	2019-03-01
卷号	25 期号:3 页码:1591-1602
关键词	Hybrid camera scene flow estimation depth upsampling
ISSN号	1077-2626
DOI	10.1109/TVCG.2018.2812879
英文摘要	In recent years, consumer-level depth cameras have been adopted for various applications. However, they often produce depth maps at only a moderately high frame rate (approximately 30 frames per second), preventing them from being used for applications such as digitizing human performance involving fast motion. On the other hand, low-cost, high-frame-rate video cameras are available. This motivates us to develop a hybrid camera that consists of a high-frame-rate video camera and a low-frame-rate depth camera and to allow temporal interpolation of depth maps with the help of auxiliary color images. To achieve this, we develop a novel algorithm that reconstructs intermediate depth maps and estimates scene flow simultaneously. We test our algorithm on various examples involving fast, non-rigid motions of single or multiple objects. Our experiments show that our scene flow estimation method is more precise than a tracking-based method and the state-of-the-art techniques.
资助项目	National Natural Science Foundation of China[61502453] ; National Natural Science Foundation of China[61772499] ; National Natural Science Foundation of China[61611130215] ; Royal Society-Newton Mobility Grant[IE150731] ; Science and Technology Service Network Initiative of Chinese Academy of Sciences[KFJ-STS-ZDTP-017] ; Knowledge Innovation Program of the Institute of Computing Technology of the Chinese Academy of Sciences[ICT20166040] ; Hong Kong Research Grants Council[CityU CityU 11237116] ; ACIM-SCM
WOS研究方向	Computer Science
语种	英语
出版者	IEEE COMPUTER SOC
WOS记录号	WOS:000457824500012
内容类型	期刊论文
源URL	[http://119.78.100.204/handle/2XEOYT63/3440]
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Xia, Shihong; Gao, Lin
作者单位	1.City Univ Hong Kong, Sch Creat Media, Hong Kong, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100190, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Yuan, Ming-Ze,Xia, Shihong,Fu, Hongbo,et al. Temporal Upsampling of Depth Maps Using a Hybrid Camera[J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS,2019,25(3):1591-1602.
APA	Yuan, Ming-Ze,Xia, Shihong,Fu, Hongbo,&Gao, Lin.(2019).Temporal Upsampling of Depth Maps Using a Hybrid Camera.IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS,25(3),1591-1602.
MLA	Yuan, Ming-Ze,et al."Temporal Upsampling of Depth Maps Using a Hybrid Camera".IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 25.3(2019):1591-1602.