QQ客服 官方微博 反馈留言

	Sparse recovery via differential inclusions
	Osher, Stanley ; Ruan, Feng ; Xiong, Jiechao ; Yao, Yuan ; Yin, Wotao
	2016
关键词	Linearized Bregman Differential inclusion Early stopping regularization Statistical consistency SCALE-SPACE METHODS THRESHOLDING ALGORITHM ATOMIC DECOMPOSITION VARIABLE SELECTION WAVELET SHRINKAGE IMAGE-RESTORATION ORACLE PROPERTIES REGRESSION LASSO L(1)-MINIMIZATION
英文摘要	In this paper, we recover sparse signals from their noisy linear measurements by solving nonlinear differential inclusions, which is based on the notion of inverse scale space (ISS) developed in applied mathematics. Our goal here is to bring this idea to address a challenging problem in statistics, i.e. finding the oracle estimator which is unbiased and sign consistent using dynamics. We call our dynamics Bregman ISS and Linearized Bregman ISS. A well-known shortcoming of LASSO and any convex regularization approaches lies in the bias of estimators. However, we show that under proper conditions, there exists a bias-free and sign-consistent point on the solution paths of such dynamics, which corresponds to a signal that is the unbiased estimate of the true signal and whose entries have the same signs as those of the true signs, i.e. the oracle estimator. Therefore, their solution paths are regularization paths better than the LASSO regularization path, since the points on the latter path are biased when sign-consistency is reached. We also show how to efficiently compute their solution paths in both continuous and discretized settings: the full solution paths can be exactly computed piece by piece, and a discretization leads to Linearized Bregman iteration, which is a simple iterative thresholding rule and easy to parallelize. Theoretical guarantees such as sign-consistency and minimax optimal l(2)-error bounds are established in both continuous and discrete settings for specific points on the paths. Early-stopping rules for identifying these points are given. The key treatment relies on the development of differential inequalities for differential inclusions and their discretizations, which extends the previous results and leads to exponentially fast recovering of sparse signals before selecting wrong ones. (C) 2016 Elsevier Inc. All rights reserved.; SCI(E); ARTICLE; 2; 436-469; 41
语种	英语
出处	SCI
出版者	5th Tri-Annual International Conference on Computational Harmonic Analysis (ICCHA)
内容类型	其他
源URL	[http://hdl.handle.net/20.500.11897/458921]
专题	数学科学学院
推荐引用方式 GB/T 7714	Osher, Stanley,Ruan, Feng,Xiong, Jiechao,et al. Sparse recovery via differential inclusions. 2016-01-01.

个性服务

查看访问统计

相关权益政策

暂无数据

收藏/分享

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。