Re: [R] " cannot allocate vector of length 1072693248"

About this list Date view Thread view Subject view Author view Attachment view

From: David L. Van Brunt, Ph.D. (dvanbrunt@well-wired.com)
Date: Sat 08 May 2004 - 02:53:45 EST


Message-id: <BCC12949.8AD3%dvanbrunt@well-wired.com>

Thanks for the suggestion. If there's a bug in my code, I can't find it.

The code runs successfully several times through. And I have only a few
lines, but repeated in blocks with a few tweaks to make different
predictions each time.

If I comment out a line that preceeds a crash, it will run a little longer
before giving up next time. So it is as if something is slowly filling up
through each run, and is accumulating.

But I do "rm()" all the objects created inside of the "for" loop, and then
gc() before the loop is finished, also.

So I'm stumped.

When I called the debugger, the last item shown was the vector line, so I
chose that option and typed "ls()"... It had only "mode" and "x". The value
of "mode" was "any", and when I tried to display "x", I expected a slew of
data but instead R crashed.

Don't know if that's informative or not!

On 5/7/04 11:42, "Prof Brian Ripley" <ripley@stats.ox.ac.uk> wrote:

> I think it is more likely that you have a bug. Probably you have run out
> of address space, as that's almost 4Gb if an integer and 8Gb if real.
>
> Can you do options(error=dump.frames) and debugger() after the error
> message and try to find out what `data' is and what size it is.
>
> On Fri, 7 May 2004, David L. Van Brunt, Ph.D. wrote:
>
>> Well, I've done everything I can think of the make the code more efficient,
>> but it seems (if I read this error message correctly) that I'm running out
>> of memory on what should be small data set.
>>
>> Here's the sequence:
>>
>> A vector of 30 possible identifiers
>> For each value, query a MySQL database to pull in 80 or so records
>> Run a few different random Forests on those data
>> Print the results as I go
>> "rm()" all the objects created in the loop, including all the old data
>> Next value, to repeat for each identifier.
>>
>>
>> Round the 3rd time through the loop, I get kicked out with:
>>
>> "Error in as.vector(data) : cannot allocate vector of length 1072693248"
>>
>> This is on Mac OS X, which is UNIX-based (from freeBSD, as I understand it),
>> so I haven't set anything special with the memory at startup. But then, I
>> only have 80 observations running through at a time, so it doesn't seem like
>> there should be a memory issue.
>>
>> Any ideas?
>>
>> ______________________________________________
>> R-help@stat.math.ethz.ch mailing list
>> https://www.stat.math.ethz.ch/mailman/listinfo/r-help
>> PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html
>>
>>

-- 
David L. Van Brunt, Ph.D.
Outlier Consulting & Development
mailto: <ocd@well-wired.com>

______________________________________________ R-help@stat.math.ethz.ch mailing list https://www.stat.math.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html


About this list Date view Thread view Subject view Author view Attachment view

This archive was generated by hypermail 2.1.3 : Mon 31 May 2004 - 23:05:08 EST