Re: [R] sqldf file specification, non-ASCII

From: Gabor Grothendieck <ggrothendieck_at_gmail.com>
Date: Thu, 03 Apr 2008 13:57:40 -0400

The Windows version is on sourceforge.

On Thu, Apr 3, 2008 at 1:29 PM, Peter Jepsen <PJ_at_dce.au.dk> wrote:
> Thank you for your help, Duncan and Gabor. Yes, I found an early line
> feed in line 1562740, so I have corrected that error. The thing is, it
> takes me many, many hours to save the file, so I would like to confirm
> that there are no more errors further down the file. The ffe tool sounds
> like a perfect tool for this job, but it doesn't seem to be available
> for Windows. Is anybody out there aware of a similar Windows tool?
>
> Thank you again for your help.
> Peter.
>
>
> -----Original Message-----
> From: Gabor Grothendieck [mailto:ggrothendieck_at_gmail.com]
> Sent: 3. april 2008 17:08
> To: Peter Jepsen
> Subject: Re: [R] sqldf file specification, non-ASCII
>
> One other thing you could try would be to run it through
> ffe (fast file extractor) which is a free utility that you can
> find via google. Use the ffe's loose argument. It can find
> bad lines and since its not dependent on R would give
> you and independent check. Regards.
>
> On Thu, Apr 3, 2008 at 10:36 AM, Gabor Grothendieck
> <ggrothendieck_at_gmail.com> wrote:
> > Hi, Can you try it with the first 100 lines, say, of the data and
> > also try reading it with read.csv to double check your arguments
> > (note that sql args are similar but not entirely identical to
> read.csv)
> > and if it still gives this error send me that 100 line file and I will
> > look at it tonight or tomorrow. Regards.
> >
> >
> > On Thu, Apr 3, 2008 at 10:22 AM, Peter Jepsen <PJ_at_dce.au.dk> wrote:
> > > Dear R-Listers,
> > >
> > > I am a Windows user (R 2.6.2) using the development version of sqldf
> to
> > > try to read a 3GB file originally stored in .sas7bdat-format. I
> convert
> > > it to comma-delimited ASCII format with StatTransfer before trying
> to
> > > import just the rows I need into R. The problem is that I get this
> > > error:
> > >
> > > > f <- file("hugedata.csv")
> > > > DF <- sqldf("select * from f where C_OPR like 'KKA2%'",
> > > file.format=list(header=T, row.names=F))
> > > Error in try({ :
> > > RS-DBI driver: (RS_sqlite_import: hugedata.csv line 1562740
> expected
> > > 52 columns of data but found 19)
> > > Error in sqliteExecStatement(con, statement, bind.data) :
> > > RS-DBI driver: (error in statement: no such table: f)
> > >
> > > Now, I know that my SAS-using colleagues are able to use this file
> with
> > > SAS, so I was wondering whether StatTransfer'ing it to the SAS XPORT
> > > format which can be read with the 'read.xport' function in the
> 'foreign'
> > > package would be a better approach. The problem is, I don't know
> > > how/whether I can do that at all with sqldf. I tried various ways
> like
> > > f <- file(read.xport("hugedata.xport"))
> > > but I consistently got an error message from the sqldf command. I
> don't
> > > recall the exact error message, unfortunately, but can anybody tell
> me
> > > whether it is at all possible to read in files in non-ASCII format
> > > without having to put them in R memory?
> > >
> > > Thank you for your assistance.
> > > Peter.
> > >
> > > ______________________________________________
> > > R-help_at_r-project.org mailing list
> > > https://stat.ethz.ch/mailman/listinfo/r-help
> > > PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> > > and provide commented, minimal, self-contained, reproducible code.
> > >
> >
>



R-help_at_r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code. Received on Thu 03 Apr 2008 - 18:13:36 GMT

Archive maintained by Robert King, hosted by the discipline of statistics at the University of Newcastle, Australia.
Archive generated by hypermail 2.2.0, at Thu 03 Apr 2008 - 19:30:25 GMT.

Mailing list information is available at https://stat.ethz.ch/mailman/listinfo/r-help. Please read the posting guide before posting to the list.

list of date sections of archive