Re: [R] Processing 10^8 rows and 1^3 columns

From: Gabor Grothendieck <ggrothendieck_at_gmail.com>
Date: Wed, 02 Jul 2008 23:36:44 -0400

The sqldf package makes it easy to use DBI, RSQLite and sqlite to read a large file directly to an sqlite database without going through R and then read all or a portion of it into R using an arbitrary SQL statement. See example 6 on the home page: http://sqldf.googlecode.com

On Wed, Jul 2, 2008 at 11:21 PM, Daren Tan <daren76_at_hotmail.com> wrote:
>
> With smaller tab-limited files, I could load them using read.table and the likes. Now I have a gigantic 10^8 rows and 1^3 columns tab-limited file for processsing, please throw some ideas how to handle it.
>
> Thanks
> _________________________________________________________________
> Publish your photos to your Space easily with Photo Gallery.
>
> [[alternative HTML version deleted]]
>
> ______________________________________________
> R-help_at_r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>



R-help_at_r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code. Received on Thu 03 Jul 2008 - 03:43:48 GMT

Archive maintained by Robert King, hosted by the discipline of statistics at the University of Newcastle, Australia.
Archive generated by hypermail 2.2.0, at Thu 03 Jul 2008 - 05:30:56 GMT.

Mailing list information is available at https://stat.ethz.ch/mailman/listinfo/r-help. Please read the posting guide before posting to the list.

list of date sections of archive