Re: [R] Another big data size problem

From: Ernesto Jardim <ernesto_at_ipimar.pt>
Date: Thu 29 Jul 2004 - 00:16:43 EST

On Wed, 2004-07-28 at 16:26, Federico Gherardini wrote:
> On Wed, 28 Jul 2004 13:28:20 +0100
> Ernesto Jardim <ernesto@ipimar.pt> wrote:
>
>
> > Hi,
> >
> > When you're writing a table to MySQL you have to be carefull if the
> > table is created by RMySQL. The fields definition may not be the most
> > adequate and there will be no indexes in your table, which makes the
> > queries _very_ slow.
> >
> So, if I understood correctly, if you want to use SQL you'll have to upload the table in SQL, directly from MySQL without using R at all, and then use RMySQL to read the elements in R?
>

If you can't get R to read the table then you can't use R/RMySQL ;)

When creating tables in MySQL you may improve a lot the speed of scaning the table with the proper fields definition and indexing. See the MySQL manual, it is a very good reference and quite easy to read (at least the sections related with table design).

The basis is to create indexes for the fields you're supose to restrict (fields to be used with the "WHERE" clause in SQL statements) considering the order of those fields.

Regards

EJ



R-help@stat.math.ethz.ch mailing list
https://www.stat.math.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html Received on Thu Jul 29 00:15:59 2004

This archive was generated by hypermail 2.1.8 : Wed 03 Nov 2004 - 22:55:18 EST