Re: [R] Can R handle medium and large size data sets?

From: Gabor Csardi <csardi_at_rmki.kfki.hu>
Date: Wed 25 Jan 2006 - 03:20:00 EST

Completely agree, i use R to analyze graphs with millions of vertices and tens of millions of edges. (Of course this is a bit different than working with data frames.)

I think your problem is that the foreign package parses/converts your data file slowly, convert it to R format and it will be much faster. The conversion can be a pain, but ideally you have to do it only once.

Gabor

On Tue, Jan 24, 2006 at 10:51:09AM -0500, Wensui Liu wrote:
> my experience is that 100,000 shouldn't be a problem. of course, it also
> depends on your computer configuration.
>
> On 1/24/06, Gueorgui Kolev <joro.kolev@gmail.com> wrote:
> >
> > Dear R experts,
> >
> > Is it true that R generally cannot handle medium sized data sets(a
> > couple of hundreds of thousands observations) and threrefore large
> > date set(couple of millions of observations)?
> >
[...]

-- 
Csardi Gabor <csardi@rmki.kfki.hu>    MTA RMKI, ELTE TTK

______________________________________________
R-help@stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html
Received on Wed Jan 25 03:30:59 2006

This archive was generated by hypermail 2.1.8 : Wed 25 Jan 2006 - 08:11:24 EST