Re: [R] lasso for variable selection

From: Liaw, Andy <andy_liaw_at_merck.com>
Date: Tue 15 Aug 2006 - 00:09:13 EST


For "importance" it's probably best to stick with absolute values of coefficients, instead of value of the penalty parameter for which the coefficients changed to non-zero.

Friedman skipped a lot of details on his rule ensemble in that talk, due to time constraint. In his implementation he was using his own algorithm, PathSeeker, for which paper and software are available on his web page. PathSeeker is a different generalization of LASSO than LAR.

HTH,
Andy

From: zubin
>
> Attended JSM last week and Friedman mentioned the use of
> LASSO for variable selection (he uses it for rules
> ensembles). I am an econometrician and not familiar with, i
> started running the examples in
> R this week and you get to the plots section of the LARS package.
> Plots of beta/max(beta) vs standardized coefficients. How
> does one interpret them? u see plots of each variable
> converging to zero at different times - its pretty cool - but
> can i use this for variable importance?
>
> for variable selection - i have a group of correlated
> variables that we need to determine importance in predicting
> change of a Y variable.
>
> -zubin
>
> ______________________________________________
> R-help@stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>
>



R-help@stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code. Received on Tue Aug 15 00:14:15 2006

Archive maintained by Robert King, hosted by the discipline of statistics at the University of Newcastle, Australia.
Archive generated by hypermail 2.1.8, at Tue 15 Aug 2006 - 02:23:23 EST.

Mailing list information is available at https://stat.ethz.ch/mailman/listinfo/r-help. Please read the posting guide before posting to the list.