[R] Reading and treating multiple files....

From: Anne <anne.piotet_at_urbanet.ch>
Date: Fri 02 Jul 2004 - 18:22:14 EST


Dear R helpers,
 this is a question connex to the subject of reading large data-sets
- I have a large db (MySQL) ~80'000 records for each year / 120 variates
from which I extract relevant info to be treated in R (no problem)

Now each record in my db represents an experimental unit; moreover I will get - in a few days- a set of separate files(one for each records....~80'000 files pro year) named key.txt in which other info (measurements of pressure and velocity at each second ) is stocked; typically each one of this separate files will hold something between 200 and 1500 records.... I'm supposed to do statistical analysis on this dataset, on the yearly information.

I haveNO influence on the format on which I' getting all this information

Well, as you can suspect my problem is thus:
- batch processing of these individual files :reading each file (automatically!), probably pattern analysis, then estimation of the relevant physical entity; for this I already need to make the connexion with the info from the database (geometrical parameters, nb in cycle....)

What is the best way to get around such a task in R?

Many thanks

Anne



Anne Piotet
Tel: +41 79 359 83 32 (mobile)
Email: anne.piotet@m-td.com

M-TD Modelling and Technology Development PSE-C
CH-1015 Lausanne
Switzerland
Tel: +41 21 693 83 98
Fax: +41 21 646 41 33
 

        [[alternative HTML version deleted]]



R-help@stat.math.ethz.ch mailing list
https://www.stat.math.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html Received on Fri Jul 02 18:29:26 2004

This archive was generated by hypermail 2.1.8 : Fri 18 Mar 2005 - 09:16:27 EST