Thread: Migration from PervasiveSQL

Migration from PervasiveSQL

From
Collin
Date:
Well, the subject says it pretty well but to elaborate:

I have a database from our ERP package that uses btrieve (PervasiveSQL)
for it's database engine. I'd like to transition all of the data to
PostgreSQL. I've been having trouble finding a suitable program to
automatically get all of the data transferred over.

I have the proper DDF files and an ODBC link in place to the data.
Maestro DataDump (from the Postgresql Data Wizard program) only locks my
machine up and it seemed to be the only think I could find that would
take an ODBC link to the btrieve data and use it to extract the table
defs and data to postgresql. Is there some other utility I could use or
am I stuck writing a custom program to do it? I could maybe extract the
btrieve data to CSV files but I don't have any easy way of doing that
quickly for so many tables (and there are a lot!)

Any help would be appreciated. Thanks!

Re: Migration from PervasiveSQL

From
"Merlin Moncure"
Date:
On 9/20/07, Collin <adderd@kkmfg.com> wrote:
> Well, the subject says it pretty well but to elaborate:
>
> I have a database from our ERP package that uses btrieve (PervasiveSQL)
> for it's database engine. I'd like to transition all of the data to
> PostgreSQL. I've been having trouble finding a suitable program to
> automatically get all of the data transferred over.
>
> I have the proper DDF files and an ODBC link in place to the data.
> Maestro DataDump (from the Postgresql Data Wizard program) only locks my
> machine up and it seemed to be the only think I could find that would
> take an ODBC link to the btrieve data and use it to extract the table
> defs and data to postgresql. Is there some other utility I could use or
> am I stuck writing a custom program to do it? I could maybe extract the
> btrieve data to CSV files but I don't have any easy way of doing that
> quickly for so many tables (and there are a lot!)

dump to csv would be ideal (you could then use the built in csv import
through pg via COPY).

barring that you need to roll some scripts or use a tool.  There are
many ways to do this of varying quality, mostly pretty dubious.  In
the microsoft world you have DTS which has an ok migrator.

merlin

Re: Migration from PervasiveSQL

From
Robert Treat
Date:
On Thursday 20 September 2007 18:38, Merlin Moncure wrote:
> On 9/20/07, Collin <adderd@kkmfg.com> wrote:
> > Well, the subject says it pretty well but to elaborate:
> >
> > I have a database from our ERP package that uses btrieve (PervasiveSQL)
> > for it's database engine. I'd like to transition all of the data to
> > PostgreSQL. I've been having trouble finding a suitable program to
> > automatically get all of the data transferred over.
> >
> > I have the proper DDF files and an ODBC link in place to the data.
> > Maestro DataDump (from the Postgresql Data Wizard program) only locks my
> > machine up and it seemed to be the only think I could find that would
> > take an ODBC link to the btrieve data and use it to extract the table
> > defs and data to postgresql. Is there some other utility I could use or
> > am I stuck writing a custom program to do it? I could maybe extract the
> > btrieve data to CSV files but I don't have any easy way of doing that
> > quickly for so many tables (and there are a lot!)
>
> dump to csv would be ideal (you could then use the built in csv import
> through pg via COPY).
>
> barring that you need to roll some scripts or use a tool.  There are
> many ways to do this of varying quality, mostly pretty dubious.  In
> the microsoft world you have DTS which has an ok migrator.
>

Perhaps odbclink could be of help here?
http://odbclink.projects.postgresql.org/

--
Robert Treat
Build A Brighter LAMP :: Linux Apache {middleware} PostgreSQL

Re: Migration from PervasiveSQL

From
"Merlin Moncure"
Date:
On 9/21/07, Robert Treat <xzilla@users.sourceforge.net> wrote:
> On Thursday 20 September 2007 18:38, Merlin Moncure wrote:
> > On 9/20/07, Collin <adderd@kkmfg.com> wrote:
> > > Well, the subject says it pretty well but to elaborate:
> > >
> > > I have a database from our ERP package that uses btrieve (PervasiveSQL)
> > > for it's database engine. I'd like to transition all of the data to
> > > PostgreSQL. I've been having trouble finding a suitable program to
> > > automatically get all of the data transferred over.
> > >
> > > I have the proper DDF files and an ODBC link in place to the data.
> > > Maestro DataDump (from the Postgresql Data Wizard program) only locks my
> > > machine up and it seemed to be the only think I could find that would
> > > take an ODBC link to the btrieve data and use it to extract the table
> > > defs and data to postgresql. Is there some other utility I could use or
> > > am I stuck writing a custom program to do it? I could maybe extract the
> > > btrieve data to CSV files but I don't have any easy way of doing that
> > > quickly for so many tables (and there are a lot!)
> >
> > dump to csv would be ideal (you could then use the built in csv import
> > through pg via COPY).
> >
> > barring that you need to roll some scripts or use a tool.  There are
> > many ways to do this of varying quality, mostly pretty dubious.  In
> > the microsoft world you have DTS which has an ok migrator.
> >
>
> Perhaps odbclink could be of help here?
> http://odbclink.projects.postgresql.org/

Development Status: 1 - Planning

:-)

merlin

Re: Migration from PervasiveSQL

From
Robert Treat
Date:
On Friday 21 September 2007 22:43, Merlin Moncure wrote:
> On 9/21/07, Robert Treat <xzilla@users.sourceforge.net> wrote:
> > On Thursday 20 September 2007 18:38, Merlin Moncure wrote:
> > > On 9/20/07, Collin <adderd@kkmfg.com> wrote:
> > > > Well, the subject says it pretty well but to elaborate:
> > > >
> > > > I have a database from our ERP package that uses btrieve
> > > > (PervasiveSQL) for it's database engine. I'd like to transition all
> > > > of the data to PostgreSQL. I've been having trouble finding a
> > > > suitable program to automatically get all of the data transferred
> > > > over.
> > > >
> > > > I have the proper DDF files and an ODBC link in place to the data.
> > > > Maestro DataDump (from the Postgresql Data Wizard program) only locks
> > > > my machine up and it seemed to be the only think I could find that
> > > > would take an ODBC link to the btrieve data and use it to extract the
> > > > table defs and data to postgresql. Is there some other utility I
> > > > could use or am I stuck writing a custom program to do it? I could
> > > > maybe extract the btrieve data to CSV files but I don't have any easy
> > > > way of doing that quickly for so many tables (and there are a lot!)
> > >
> > > dump to csv would be ideal (you could then use the built in csv import
> > > through pg via COPY).
> > >
> > > barring that you need to roll some scripts or use a tool.  There are
> > > many ways to do this of varying quality, mostly pretty dubious.  In
> > > the microsoft world you have DTS which has an ok migrator.
> >
> > Perhaps odbclink could be of help here?
> > http://odbclink.projects.postgresql.org/
>
> Development Status: 1 - Planning
>
> :-)
>

*shrug*  There's code in the scm repository if you look, and if that doesn't
seem workable try emailing Hiroshi directly.  I'm pretty sure you can get
this wokring; Hiroshi gave a lightening talk on it at PGCon.

--
Robert Treat
Build A Brighter LAMP :: Linux Apache {middleware} PostgreSQL

Re: Migration from PervasiveSQL

From
Ow Mun Heng
Date:
On Sat, 2007-09-22 at 16:05 -0400, Robert Treat wrote:
> On Friday 21 September 2007 22:43, Merlin Moncure wrote:
> > On 9/21/07, Robert Treat <xzilla@users.sourceforge.net> wrote:
> > > On Thursday 20 September 2007 18:38, Merlin Moncure wrote:
> > > > On 9/20/07, Collin <adderd@kkmfg.com> wrote:
> > > > > Well, the subject says it pretty well but to elaborate:
> > > > >
> > > > dump to csv would be ideal (you could then use the built in csv import
> > > > through pg via COPY).
> > > >
> > > > barring that you need to roll some scripts or use a tool.  There are
> > > > many ways to do this of varying quality, mostly pretty dubious.  In
> > > > the microsoft world you have DTS which has an ok migrator.

What about Perl? DBI? Not sure if it supports PervasiveSQL


Re: Migration from PervasiveSQL

From
Robert Treat
Date:
On Sunday 23 September 2007 23:43, Ow Mun Heng wrote:
> On Sat, 2007-09-22 at 16:05 -0400, Robert Treat wrote:
> > On Friday 21 September 2007 22:43, Merlin Moncure wrote:
> > > On 9/21/07, Robert Treat <xzilla@users.sourceforge.net> wrote:
> > > > On Thursday 20 September 2007 18:38, Merlin Moncure wrote:
> > > > > On 9/20/07, Collin <adderd@kkmfg.com> wrote:
> > > > > > Well, the subject says it pretty well but to elaborate:
> > > > >
> > > > > dump to csv would be ideal (you could then use the built in csv
> > > > > import through pg via COPY).
> > > > >
> > > > > barring that you need to roll some scripts or use a tool.  There
> > > > > are many ways to do this of varying quality, mostly pretty dubious.
> > > > >  In the microsoft world you have DTS which has an ok migrator.
>
> What about Perl? DBI? Not sure if it supports PervasiveSQL
>

The OP stated he already had ODBC connectors setup.

--
Robert Treat
Build A Brighter LAMP :: Linux Apache {middleware} PostgreSQL

Re: Migration from PervasiveSQL

From
Collin
Date:


>> What about Perl? DBI? Not sure if it supports PervasiveSQL
>>
>>
>
> The OP stated he already had ODBC connectors setup.
>
>

Yes, I already have ODBC setup. I'm basically just writing a little
something myself that uses the existing Pervasive and Postgres tools as
much as possible.

On a side note, not that it surprises me but it is a little weird that
Pervasive supported postgresql for a while but yet there is no really
good way to convert from pervasive to postgres. I've always thought that
Pervasive backing out had a lot more to do with them suddenly realizing
they were showing the world a better product than theirs and not because
of the large amount of support postgresql already had (like they claimed
the  reason was...)

Re: Migration from PervasiveSQL

From
nelsonsoft
Date:
You might take a look at BtSearch at www.nssdd.com.  It will allow you
to export all the Btrieve files in a DDF to CSV format.

Gil


Re: Migration from PervasiveSQL

From
"Hiroshi Saito"
Date:
Hi.

Sorry, very late reaction...

----- Original Message -----
From: "Robert Treat" <xzilla@users.sourceforge.net>


> On Friday 21 September 2007 22:43, Merlin Moncure wrote:
>> On 9/21/07, Robert Treat <xzilla@users.sourceforge.net> wrote:
>> > On Thursday 20 September 2007 18:38, Merlin Moncure wrote:
>> > > On 9/20/07, Collin <adderd@kkmfg.com> wrote:
>> > > > Well, the subject says it pretty well but to elaborate:
>> > > >
>> > > > I have a database from our ERP package that uses btrieve
>> > > > (PervasiveSQL) for it's database engine. I'd like to transition all
>> > > > of the data to PostgreSQL. I've been having trouble finding a
>> > > > suitable program to automatically get all of the data transferred
>> > > > over.
>> > > >
>> > > > I have the proper DDF files and an ODBC link in place to the data.
>> > > > Maestro DataDump (from the Postgresql Data Wizard program) only locks
>> > > > my machine up and it seemed to be the only think I could find that
>> > > > would take an ODBC link to the btrieve data and use it to extract the
>> > > > table defs and data to postgresql. Is there some other utility I
>> > > > could use or am I stuck writing a custom program to do it? I could
>> > > > maybe extract the btrieve data to CSV files but I don't have any easy
>> > > > way of doing that quickly for so many tables (and there are a lot!)
>> > >
>> > > dump to csv would be ideal (you could then use the built in csv import
>> > > through pg via COPY).
>> > >
>> > > barring that you need to roll some scripts or use a tool.  There are
>> > > many ways to do this of varying quality, mostly pretty dubious.  In
>> > > the microsoft world you have DTS which has an ok migrator.
>> >
>> > Perhaps odbclink could be of help here?
>> > http://odbclink.projects.postgresql.org/

Thanks great information.:-)

>>
>> Development Status: 1 - Planning
>>
>> :-)

Yes, I'm the stage which has searched the figure which should desire it.
I see the figure of the application business used realized with two or more
databases. Then, I have explored the solution method which does not spoil
those property. Probably, ORACLE, DB2, SQLServer, and PostgreSQL
live together. On that occasion, They wish data to flow smoothly between
those databases. However, Now odbclink has not equipped cursor yet....

>
> *shrug*  There's code in the scm repository if you look, and if that doesn't
> seem workable try emailing Hiroshi directly.  I'm pretty sure you can get
> this wokring; Hiroshi gave a lightening talk on it at PGCon.

I progress little by little. It seems to be a tortoise completely.:-)

Thanks.!

Regards,
Hiroshi Saito