File Download
Supplementary
-
Citations:
- Appears in Collections:
postgraduate thesis: On Lasso-type estimators under a moving-parameter framework
Title | On Lasso-type estimators under a moving-parameter framework |
---|---|
Authors | |
Issue Date | 2016 |
Publisher | The University of Hong Kong (Pokfulam, Hong Kong) |
Citation | Cai, W. [蔡文龍]. (2016). On Lasso-type estimators under a moving-parameter framework. (Thesis). University of Hong Kong, Pokfulam, Hong Kong SAR. |
Abstract | Limiting distributions and residual bootstrap methods for Lasso-type regression estimators under a moving parameter framework are investigated in this thesis.
In the first part, we study the asymptotic behaviour of Lasso-type regression estimators under a general moving-parameter framework and minimal assumptions on design covariates. Our results elucidate how distributional properties of the estimators are affected by the values of individual regression coefficients. In particular, we show that the convergence rates of estimators of large coefficients depend critically on the magnitudes of coefficients that are close to zero, even when the estimators possess the acclaimed oracle property under a fixed-parameter asymptotic framework. We demonstrate in the case of SCAD estimation how our theoretical results motivate a solution path-based procedure for diagnosing viability of the oracle property in practice.
In the second part, we consider moving-parameter asymptotic properties of residual bootstrap methods recently proposed for making statistical inference based on Lasso-type estimators. We show that consistency of the natural residual bootstrap Lasso-type distribution depends critically on whether orders of individual regression coefficients can be correctly restored. In particular, if there exist small coefficients close, but not equal, to zero, the natural residual bootstrap may be inconsistent even when it is applied to estimate the distribution of a large coefficient estimator. To help alleviate this problem, we propose a hybrid residual bootstrap method, which uses a hybrid estimator based on an oracle and ordinary least squares estimators, to restore more correctly the orders of the small coefficients. In hypothesis testing problems, we show by simulations that the natural residual bootstrap of the conventional Studentized test statistic often suffers from over-rejection in the presence of small coefficients. As a remedy we propose two modified test statistics and a constrained residual bootstrap method for the hypothesis test. Our simulation results suggest that our new testing procedures improve upon existing methods. |
Degree | Doctor of Philosophy |
Subject | Regression analysis Estimation theory |
Dept/Program | Statistics and Actuarial Science |
Persistent Identifier | http://hdl.handle.net/10722/231048 |
HKU Library Item ID | b5784865 |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Cai, Wenlong | - |
dc.contributor.author | 蔡文龍 | - |
dc.date.accessioned | 2016-09-01T23:42:43Z | - |
dc.date.available | 2016-09-01T23:42:43Z | - |
dc.date.issued | 2016 | - |
dc.identifier.citation | Cai, W. [蔡文龍]. (2016). On Lasso-type estimators under a moving-parameter framework. (Thesis). University of Hong Kong, Pokfulam, Hong Kong SAR. | - |
dc.identifier.uri | http://hdl.handle.net/10722/231048 | - |
dc.description.abstract | Limiting distributions and residual bootstrap methods for Lasso-type regression estimators under a moving parameter framework are investigated in this thesis. In the first part, we study the asymptotic behaviour of Lasso-type regression estimators under a general moving-parameter framework and minimal assumptions on design covariates. Our results elucidate how distributional properties of the estimators are affected by the values of individual regression coefficients. In particular, we show that the convergence rates of estimators of large coefficients depend critically on the magnitudes of coefficients that are close to zero, even when the estimators possess the acclaimed oracle property under a fixed-parameter asymptotic framework. We demonstrate in the case of SCAD estimation how our theoretical results motivate a solution path-based procedure for diagnosing viability of the oracle property in practice. In the second part, we consider moving-parameter asymptotic properties of residual bootstrap methods recently proposed for making statistical inference based on Lasso-type estimators. We show that consistency of the natural residual bootstrap Lasso-type distribution depends critically on whether orders of individual regression coefficients can be correctly restored. In particular, if there exist small coefficients close, but not equal, to zero, the natural residual bootstrap may be inconsistent even when it is applied to estimate the distribution of a large coefficient estimator. To help alleviate this problem, we propose a hybrid residual bootstrap method, which uses a hybrid estimator based on an oracle and ordinary least squares estimators, to restore more correctly the orders of the small coefficients. In hypothesis testing problems, we show by simulations that the natural residual bootstrap of the conventional Studentized test statistic often suffers from over-rejection in the presence of small coefficients. As a remedy we propose two modified test statistics and a constrained residual bootstrap method for the hypothesis test. Our simulation results suggest that our new testing procedures improve upon existing methods. | - |
dc.language | eng | - |
dc.publisher | The University of Hong Kong (Pokfulam, Hong Kong) | - |
dc.relation.ispartof | HKU Theses Online (HKUTO) | - |
dc.rights | The author retains all proprietary rights, (such as patent rights) and the right to use in future works. | - |
dc.rights | This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. | - |
dc.subject.lcsh | Regression analysis | - |
dc.subject.lcsh | Estimation theory | - |
dc.title | On Lasso-type estimators under a moving-parameter framework | - |
dc.type | PG_Thesis | - |
dc.identifier.hkul | b5784865 | - |
dc.description.thesisname | Doctor of Philosophy | - |
dc.description.thesislevel | Doctoral | - |
dc.description.thesisdiscipline | Statistics and Actuarial Science | - |
dc.description.nature | published_or_final_version | - |
dc.identifier.doi | 10.5353/th_b5784865 | - |
dc.identifier.mmsid | 991020535539703414 | - |