Re: [R] bootstrapping and penalizing regression

From: Frank E Harrell Jr <>
Date: Tue, 15 Apr 2008 07:11:19 -0500

> Dear list,
> sorry for asking a more statistical question. I have been reading on
> penalyzing estimates of regression and bootstrapping regression,
> trying to include both or either in my analysis. But it is not clear
> to me (mainly due to my non-statistics background) whether they aim to
> do similar things in the case of regression, i.e. to get robust
> estimates, or there is a completely different goal to applying them.
> Reading and using "logistf" and "penalized" packages for penalization
> and "boot" and "bootstrap" and John Fox´s append on bootstrapping, I
> think penalization aims at the coefficients, but bootstrapping aims at
> standard errors and CIs.
> Can anyone tell me whether I am far from understanding both concepts?
> Thanks in advance
> David


I think you have contrasted the two approaches fairly accurately. Penalization is an estimation technique used up front to improve the mean squared error for predictions and parameter estimates. Bootstrapping (except for bootstrap bumping, bagging, and a few other variations) is used primarily to inform you of the variation or bias of a specific estimator.


Frank E Harrell Jr   Professor and Chair           School of Medicine
                      Department of Biostatistics   Vanderbilt University

______________________________________________ mailing list
PLEASE do read the posting guide
and provide commented, minimal, self-contained, reproducible code.
Received on Tue 15 Apr 2008 - 12:38:58 GMT

Archive maintained by Robert King, hosted by the discipline of statistics at the University of Newcastle, Australia.
Archive generated by hypermail 2.2.0, at Tue 15 Apr 2008 - 13:30:28 GMT.

Mailing list information is available at Please read the posting guide before posting to the list.

list of date sections of archive