From: Doran, Harold <HDoran_at_air.org>

Date: Wed 14 Dec 2005 - 00:36:45 EST

R-help@stat.math.ethz.ch mailing list

https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide!

http://www.R-project.org/posting-guide.html

R-help@stat.math.ethz.ch mailing list

https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html Received on Wed Dec 14 01:44:50 2005

Date: Wed 14 Dec 2005 - 00:36:45 EST

I should have also noted in this email how I have allocated memory and
an error that appears.

I'm using Windows, so as in FAQ 2.2 I did

"C:\Program Files\R\R-2.2.0\bin\Rgui.exe" --sdi --max-mem-size=2Gb

# Check memory size in R

> example(memory.size)

mmry.s> memory.size()

[1] 11894064

mmry.s> memory.size(TRUE)

[1] 12500992

mmry.s> round(memory.limit()/1048576, 2) [1] 2048

An interesting issue appears after trying to import the subset of the larger file (which is a csv file 75,238 KB). R indicates it has run out of memory as:

Error: vector memory exhausted (limit reached?) Error: vector memory exhausted (limit reached?)

So, when I then try to quit R, it doesn't allow me to. Here is a copy and paste from my workspace.

> quit()

Error: vector memory exhausted (limit reached?)

> quit()

Error: recursive default argument reference

> quit()

Error: vector memory exhausted (limit reached?)

*>
*

Clearly, enough memory is allocated to handle this file. But, I also wonder why R then locks and I need to do a forced shut down.

-----Original Message-----

From: r-help-bounces@stat.math.ethz.ch

[mailto:r-help-bounces@stat.math.ethz.ch] On Behalf Of Doran, Harold
Sent: Tuesday, December 13, 2005 5:33 AM
To: r-help@stat.math.ethz.ch

Subject: [R] Technique for reading large sparse fwf data file

But, I am unable to read in the file even though I have allocated sufficient memory to R for this.

Does anyone have any thoughts on a strategy?

[[alternative HTML version deleted]]

R-help@stat.math.ethz.ch mailing list

https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide!

http://www.R-project.org/posting-guide.html

R-help@stat.math.ethz.ch mailing list

https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html Received on Wed Dec 14 01:44:50 2005

*
This archive was generated by hypermail 2.1.8
: Wed 14 Dec 2005 - 02:33:55 EST
*