Re: [R] Error in vector("double", length) : vector size specified is too large....VLDs

From: Tom Colson <tom_colson_at_ncsu.edu>
Date: Fri 16 Sep 2005 - 04:53:33 EST

 

> rm(data1)
> variog.1.b <- variog(raw.data)
variog: computing omnidirectional variogram Error in vector("double", length) : vector size specified is too large

Turns out I was wrong re: # of rows...it's 304,000

Same problem. Version is 2.1.1, hardware is Dual Xeon 3.6 4 GB RAM, XP Pro 64 Bit. Can reproduce the problem with 64Bit R 2.1.1 running on Fedora 4, same hardware.

Thomas Colson
North Carolina State University
Department of Forestry and Environmental Resources (919) 673 8023
tom_colson@ncsu.edu

Calendar:
www4.ncsu.edu/~tpcolson  

-----Original Message-----
From: Douglas Grove [mailto:dgrove@fhcrc.org] Sent: Thursday, September 15, 2005 2:23 PM To: Tom Colson
Subject: Re: [R] Error in vector("double", length) : vector size specified is too large....VLDs

Well you could start by removing large objects that you aren't using (e.g. 'data1') and seeing if that helps.

There may be other suggestions but you haven't told us what platform you're working on, as the posting guide requests:

> PLEASE do read the posting guide!
> http://www.R-project.org/posting-guide.html

Doug

On Thu, 15 Sep 2005, Tom Colson wrote:

> I have what R seems to consider a very large dataset, a 12MB text file
> of lat,long,and height values, 130,000 rows to be exact.
>
> Here's what I get:
> > data1 <- data.frame(read.table("BE3720078500WC20020828.txt",sep=",",
> header=T))
> > raw.data <- as.geodata(data1)
> > variog.1.b <- variog(raw.data)
> variog: computing omnidirectional variogram Error in vector("double",
> length) : vector size specified is too large
> > round(memory.limit()/1048576.0, 2)
> [1] 4000
>
>
>
> The "Vector size specified is too large" seems to be a common error,
> but I haven't seen any workarounds posted...and the help.archive web
> site seems to be down. I can plot the dataset, do some elementary
> stats on it...no variogram though.
>
>
> Any ideas on how to compute variograms on datasets with 100 to 300k
points?
> Thanks
>
> Thomas Colson
> North Carolina State University
> Department of Forestry and Environmental Resources
> (919) 673 8023
> tom_colson@ncsu.edu
>
> Calendar:
> www4.ncsu.edu/~tpcolson
>
> ______________________________________________
> R-help@stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide!
> http://www.R-project.org/posting-guide.html
>



R-help@stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html Received on Wed Sep 21 02:27:58 2005

This archive was generated by hypermail 2.1.8 : Fri 03 Mar 2006 - 03:40:15 EST