Re: [R] loop over large dataset

From: Federico Calboli <>
Date: Mon 04 Jul 2005 - 23:29:38 EST

On 4 Jul 2005, at 12:41, Uwe Ligges wrote:

> Federico Calboli wrote:
>> In my absentmindedness I'd forgotten to CC this to the list...
>> and BTW, using gc() in the loop increases the runtime...
> If the data size increases, you cannot expect linear run time
> behaviour, e.g. because gc() is called more frequently. And of
> course, gc() needs some time, hence you get the expected increase
> in runtime. This answers you other question as well.

Is then internal gc() calls that increase the runtime from 5 minutes to more then 24 hours for a 27x increase in data (given that the code is exactely the same)?


Federico C. F. Calboli
Department of Epidemiology and Public Health
Imperial College, St. Mary's Campus
Norfolk Place, London W2 1PG

Tel +44 (0)20 75941602   Fax +44 (0)20 75943193

f.calboli [.a.t]
f.calboli [.a.t]

______________________________________________ mailing list
PLEASE do read the posting guide!
Received on Mon Jul 04 23:34:26 2005

This archive was generated by hypermail 2.1.8 : Fri 03 Mar 2006 - 03:33:11 EST