Re: [R] memory constraints in ubuntu gutsy

From: Rod <villegas.ro_at_gmail.com>
Date: Tue, 04 Mar 2008 21:11:03 +0100

On Tue, Mar 4, 2008 at 7:18 PM, Prof Brian Ripley <ripley_at_stats.ox.ac.uk> wrote:

> A 64-bit version of R would be able to handle this (preferably with more
> RAM), but you don't appear to have one. Check what .Machine$size.pointer
> says: I expect 4.
>
> On Tue, 4 Mar 2008, Randy Griffiths wrote:
>
> > Hello All,
> >
> > I have a very large data set (1.1GB) that I am trying to read into R.
> The
> > file is tab delimited and contains headers; there are over 800 columns
> and
> > almost 700,000 rows. I am using the Ubuntu 7.10 Gutsy Gibbon version of
> R. I
> > am using Kernel Linux 2.6.22-14-generic. I have 3.1GB of RAM with the
> AMD
> > Athlon(tm) 64 Processor 3200+. I downloaded R using the instructions
> from
> > cran under Linux-Ubuntu.
>
> That's too vague. Do you have an ix86 or x86_66 OS? I see i386 and amd64
> builds on that page: which did you install?
>
> > I need to be able to read the whole data set into R, but when I try
> right
> > now, it will only use 4.2GB of the swap space (50% of the 8.5GBcurrently
> > available) and won't go any further. I am new to Linux, but anxious to
> > learn. Is there a memory constraint with this build of R? or is this
> > something that can be fixed with hardware (like more RAM)? I thought
> that a
> > 64bit version of R would be able to handle data of this magnitude. Is
> there
> > a different version of Linux that is better for reading in large data
> sets
> > such as this one?
> >
> > I know that databases can be used for large data, but i need run
> > discriminant analysis or randomForest on all of the variables.
> >
> > Any of your suggestions would be very much appreciated.
> >
> > Sincerely,
> >
> > Randy Griffiths
> >
> > [[alternative HTML version deleted]]
> >
> > ______________________________________________
> > R-help_at_r-project.org mailing list
> > https://stat.ethz.ch/mailman/listinfo/r-help
> > PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> > and provide commented, minimal, self-contained, reproducible code.
> >
>
> --
> Brian D. Ripley, ripley_at_stats.ox.ac.uk
> Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/<http://www.stats.ox.ac.uk/%7Eripley/>
> University of Oxford, Tel: +44 1865 272861 (self)
> 1 South Parks Road, +44 1865 272866 (PA)
> Oxford OX1 3TG, UK Fax: +44 1865 272595
>
> ______________________________________________
> R-help_at_r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>

I think is .Machine$sizeof.pointer

Rod

        [[alternative HTML version deleted]]



R-help_at_r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code. Received on Tue 04 Mar 2008 - 20:14:14 GMT

Archive maintained by Robert King, hosted by the discipline of statistics at the University of Newcastle, Australia.
Archive generated by hypermail 2.2.0, at Tue 04 Mar 2008 - 22:30:19 GMT.

Mailing list information is available at https://stat.ethz.ch/mailman/listinfo/r-help. Please read the posting guide before posting to the list.

list of date sections of archive