[R-pkgs] sparsenet: a new package for sparse model selection

From: Trevor Hastie <hastie_at_stanford.edu>
Date: Tue, 06 Mar 2012 19:54:54 -0800


We have put a new package sparsenet on CRAN.

Sparsenet fits regularization paths for sparse model selection via coordinate descent, using a penalized least-squares framework and a non-convex penalty.

The package is based on our JASA paper
Rahul Mazumder, Jerome Friedman and Trevor Hastie: SparseNet : Coordinate Descent with Non-Convex Penalties. (JASA 2011) http://www.stanford.edu/~hastie/Papers/Sparsenet/jasa_MFH_final.pdf

We use Zhang's MC+ penalty to impose sparsity in model selection. This penalty parametrizes a family ranging between L1 and L0 regularization. One nice feature of this family is that the single-coordinate optimization problems are convex, making it ideal for coordinate descent.

The package fits the regularization surface for each parameter - a surface over the two-dimensional space of tuning parameters. The concavity parameter gamma indexes the member of the family, and lambda is the usual Lagrange penalty parameter which determines the strength of the penalty.

Sparsenet is extremely fast. For example, with 10K variables and 1K samples, the entire surface with 10 values of gamma and 50 values of lambda takes under a second on a Macbook Pro.

The package includes functions for fitting, plotting and cross-validation of the models, as well as methods for prediction.

Trevor Hastie, with Jerome Friedman and Rahul Mazumder  



R-packages mailing list
R-packages_at_r-project.org
https://stat.ethz.ch/mailman/listinfo/r-packages Received on Wed 07 Mar 2012 - 15:00:32 EST

This archive was generated by hypermail 2.2.0 : Wed 07 Mar 2012 - 15:10:02 EST