Evaluation of Penalized Estimation Methods for Big Data Analysis
Abstract
In this paper we described the sparse Laplacian shrinkage (SLS) method which is a penalized method for variable selection and estimation in big data analysis that uses a combination of the minimax concave penalty (MCP) and Laplacian quadratic as the penalty. The SLS uses the MCP to promote sparsity and Laplacian quadratic penalty to encourage smoothness among coefficients associated with the correlated predictors. An important advantage of the MCP over the penalty is that it leads to estimators that are nearly unbiased and achieve selection consistency under weaker conditions. In some problems such as genomic data analysis, partial external information may also be available on the graphical structure of some genes used as predictors in the model. It would be interesting to consider approaches for combining external information on the graphical structure with existing data in constructing the Laplacian quadratic penalty. We discussed a comparative study with ridge regression (Ridge), Lasso, MCP and SLS estimator. For different sample and variable size, our simulation studies demonstrate that SLS estimator is the best estimator.
Keywords: Big data, minimax concave penalty (MCP), sparse Laplacian shrinkage (SLS) estimator
Cite this Article
Rahman MS, Rahman MM, Matin MA. Evaluation of Penalized Estimation Methods for Big Data Analysis. Research & Reviews: A Journal of Bioinformatics. 2015; 2(2): 49–55p.
Downloads
Published
Issue
Section
License
Copyright Transfer and Declaration Form (Please compile this form, sign and send by e-mail and post)
Journal Title:
Title of the Paper:
Corresponding Author’s Information:
Name:
Address:
E-mail:
Contact Number:
It is herein agreed that:
The copyright to the above-listed unpublished and original article is transferred to STM Journals. This copyright transfer covers the exclusive right to reproduce and distribute the contribution, including reprints, translations, photographic reproductions, microform, electronic form (offline, online), or any other reproductions of similar nature. I/We declare that above manuscript is not published already in part or whole (except in the form of abstract) in any journal or magazine for private or public circulation, and, is not under consideration of publication elsewhere. I/ We warrant(s) that his/her/their contribution is original, except for such excerpts from copyrighted works as may be included with the permission of the copyright holder and author thereof, that it contains no libelous statements, and does not infringe on any copyright, trademark, patent, statutory right, or propriety right of others. I/We will not publish his/her/their above said contribution anywhere else without the prior written permission of the publisher unless it has been changed substantially.
I/We also agree to the authorship of the article in the following order:
Author(s) Name Signature(s)
1. ________________
2. ________________
3. ________________
4. ________________
The author(s) agree to the terms of this Copyright Notice, which will apply to this submission if and when it is published by this journal (comments if any to the editor can be added below).