Re: [R] How to handle large dataframes?

From: Wensui Liu <liuwensui_at_gmail.com>
Date: Wed 15 Feb 2006 - 02:36:09 EST

do you want to use the dataset as it is? if not, it might be better save the data into a database, such as sqlite, and then odbc to it? Then you can use sql to only fetch the data you want for analysis.

On 2/14/06, Christian Bieli <christian.bieli@unibas.ch> wrote:
>
> Dear all
>
> I imported a Stata .dta file with the read.dta-function from the
> foreign-package. The dataframe's dimensions are
>
> > dim(d.apc)
> [1] 15806 1300
>
> Importing needs up to 15 min and calculations with these data are rather
> slow (although I subset the data before starting analyses).
>
> My questions are:
> 1. Has someone experiences importing Stata files (alternatives to
> read.dta) ?
> 2. To my knowledge R should not have problems handling dataframes of
> this size. Is there something I can do after importing that makes data
> handling faster?
>
> My hardware is up-to-date (Intel P4, 3 Ghz, 1 GB RAM) and I work on a
> Windows XP platform.
> I am working on a Windows XP platform with R version 2.1 (all packages
> updated).
>
> Thanks for your answers.
> Christian
>
> --
> Christian Bieli, project assistant
> Institute of Social and Preventive Medicine
> University of Basel, Switzerland
> Steinengraben 49
> CH-4051 Basel
> Tel.: +41 61 270 22 12
> Fax: +41 61 270 22 25
> christian.bieli@unibas.ch
> www.unibas.ch/ispmbs
>
> ______________________________________________
> R-help@stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide!
> http://www.R-project.org/posting-guide.html
>

--
WenSui Liu
(http://statcompute.blogspot.com)
Senior Decision Support Analyst
Health Policy and Clinical Effectiveness
Cincinnati Children Hospital Medical Center

	[[alternative HTML version deleted]]

______________________________________________
R-help@stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html
Received on Wed Feb 15 02:42:39 2006

This archive was generated by hypermail 2.1.8 : Wed 15 Feb 2006 - 14:35:56 EST