Re: [R] large dataset!

From: rdporto1 <rdporto1_at_terra.com.br>
Date: Tue 04 Jul 2006 - 01:46:52 EST


Jennifer,

we had a little discussion about this topic last May when I had a similar problem.
It is archived at

http://finzi.psych.upenn.edu/R/Rhelp02a/archive/76401.html

You can follow the thread to see the various arguments and solutions. I tried to summarize the possible suggested approachs at

http://finzi.psych.upenn.edu/R/Rhelp02a/archive/76583.html

HTH, Rogerio Porto.

De: r-help-bounces@stat.math.ethz.ch
Para: r-help@stat.math.ethz.ch
Cópia:
Data: Sun, 2 Jul 2006 10:12:25 -0400 (EDT) Assunto: [R] large dataset!

>
> Hi, I need to analyze data that has 3.5 million observations and
> about 60 variables and I was planning on using R to do this but
> I can't even seem to read in the data. It just freezes and ties
> up the whole system -- and this is on a Linux box purchased about
> 6 months ago on a dual-processor PC that was pretty much the top
> of the line. I've tried expanding R the memory limits but it
> doesn't help. I'll be hugely disappointed if I can't use R b/c
> I need to do build tailor-made models (multilevel and other
> complexities). My fall-back is the SPlus big data package but
> I'd rather avoid if anyone can provide a solution....
>
> Thanks!!!!
>
> Jennifer Hill
>
> ______________________________________________
> R-help@stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html
>



R-help@stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html Received on Tue Jul 04 01:54:19 2006

Archive maintained by Robert King, hosted by the discipline of statistics at the University of Newcastle, Australia.
Archive generated by hypermail 2.1.8, at Tue 04 Jul 2006 - 04:14:41 EST.

Mailing list information is available at https://stat.ethz.ch/mailman/listinfo/r-help. Please read the posting guide before posting to the list.