Estimation Error of the Constrained Lasso
This paper presents a non-asymptotic upper bound for the estimation error of the constrained lasso, under the high-dimensional ($n \ll p$) setting. In contrast to existing results, the error bound in this paper is sharp, is valid when the parameter to be estimated is not exactly sparse (e.g., when it is weakly sparse), and shows explicitly the effect of over-estimating the $\ell_1$-norm of the parameter to be estimated on the estimation performance. The results of this paper show that the constrained lasso is minimax optimal for estimating a parameter with bounded $\ell_1$-norm, and also for estimating a weakly sparse parameter if its $\ell_1$-norm is accessible.
Cite this item
Zerbib, N., Li, Y.-H., Hsieh, Y.-P., & Cevher, V. (2016). Estimation Error of the Constrained Lasso. 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 433–438. https://doi.org/10.1109/ALLERTON.2016.7852263
Click Copy to copy the citation, or select the text manually.
lasso_error.pdf
Preprint
Submitted version (Preprint)
openaccess
242.25 KB
Adobe PDF
e88d19a9cb06686f34168b047fa50a74