Re: [R] preprocessing data

From: David Smith <dsmith_at_insightful.com>
Date: Wed 17 Aug 2005 - 08:50:10 EST


> My question is concerning the line
> "This is adequate for small files, but for anything more
> complicated we
> recommend using the facilities of a language like perl to
> pre-process the file."

An alternative to Perl is to use the big data library of S-PLUS 7 Enterprise, which would allow you to read in the entire fixed-format file and pre-process it using S commands. You could then export the processed data to a file from S-PLUS and import into R. If your university has S-PLUS, S-PLUS 7 Enterprise should be available (all academic institutions were upgraded to S-PLUS 7 Enterprise, which has the big data library).

You can read more information about the big data library at:

http://www.insightful.com/insightful_doclib/document.asp?id=167

# David Smith

-- 
David M Smith <dsmith@insightful.com>
Senior Product Manager, Insightful Corp, Seattle WA
Tel: +1 (206) 802 2360
Fax: +1 (206) 283 6310

New S-PLUS 7! Create advanced statistical applications with large data sets.
www.insightful.com/splus


> -----Original Message-----
> From: Jean Eid [mailto:jeaneid@chass.utoronto.ca]
> Sent: Tuesday, August 16, 2005 5:39 AM
> To: r-help@stat.math.ethz.ch
> Subject: [R] preprocessing data
>
>
> Dear all,
>
> My question is concerning the line
> "This is adequate for small files, but for anything more
> complicated we
> recommend using the facilities of a language like perl to
> pre-process
> the file."
>
> in the import/export manual.
>
> I have a large fixed-width file that I would like to
> preprocess in Perl or
> awk. The problem is that I do not know where to start. Does
> anyone have a
> simple example on how to turn a fixed-width file in any of these
> facilities into csv or tab delimited file. I guess I am looking for
> somewhat a perl for dummies or awk for dummies that does this. any
> pointers for website will be greatly appreciated
>
> Thank you
>
>
> Jean Eid
>
> ______________________________________________
> R-help@stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide!
> http://www.R-project.org/posting-guide.html
>
______________________________________________ R-help@stat.math.ethz.ch mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html
Received on Wed Aug 17 08:56:30 2005

This archive was generated by hypermail 2.1.8 : Sun 23 Oct 2005 - 15:25:12 EST