Re: [R] R usage for log analysis

From: Gabriel Diaz <>
Date: Mon 12 Jun 2006 - 23:52:28 EST


Thanks all for the answers.

I'm taking an overview to the project documentation, and seems the database is the way to go to handle log files of GB order (normally between 2 and 4 GB each 15 day dump).

In this document, says R will load all data into memory to process it when using read.table and such. Using a database will do the same? Well, currently i have no machine with > 2 GB of memory.

The moodss thing looks nice, thanks for the link. But what i have to do now is an offline analysis of big log files :-). I will try to go with the mysql -> R way.


On 6/12/06, Jean-Luc Fontaine <> wrote:
> Hash: SHA1
> Allen S. Rout wrote:
> >
> >
> > Don't expect a warm welcome. This community is like all open-source
> > communities, sharply focused on its' own concerns and expertise. And,
> > in an unusual experience for computer types, our core competencies
> > hold little or no sway here; they don't even give us much of a leg up.
> > Just wait 'till you want to do something nutso like produce a business
> > graphic. :)
> >
> > I'm working on understanding enough of R packaging and documentation
> > to begin a 'task view' focused on systems administration, for humble
> > submission. That might end up being mostly "log analysis"; the term
> > can describe much of what we do, if it's stretched a bit. I'm hoping
> > the task view will attract the teeming masses of sysadmins trapped in
> > the mire of Gnuplot and friends.
> Although not specifically solving the problem at hand, you might want
> to take a look at moodss and moomps (,
> modular monitoring applications, which uses R
> ( and its log module
> (
> - --
> Jean-Luc Fontaine
> Version: GnuPG v1.4.3 (GNU/Linux)
> Comment: Using GnuPG with Fedora -
> iD8DBQFEjT2ykG/MMvcT1qQRAuF6AJ9nf5phV/GMmCHPuc5bVyA+SoXqGACgnLuZ
> =V8yo
> ______________________________________________
> mailing list
> PLEASE do read the posting guide!
> mailing list PLEASE do read the posting guide! Received on Mon Jun 12 23:57:12 2006

Archive maintained by Robert King, hosted by the discipline of statistics at the University of Newcastle, Australia.
Archive generated by hypermail 2.1.8, at Tue 13 Jun 2006 - 04:12:58 EST.

Mailing list information is available at Please read the posting guide before posting to the list.