Thread: Dumping partial database content
Hi, I need to dump only partial content of my database, for example i want to dump only records that has been insterted to the database from a specific date. I tried to use pg_dump/pg_export but did not find anything usefull. I'm using postgres version 7.3 on Linux RH 7.3 any idea/direction ? Regards, Hanan
I don't believe there is an option in pg_dump that current handles that. It is the whole table / object or nothing at all. Depending on the volume of transactions and frequency that you need to dump the data will determine which solution works best for you. Heavy volume and/or dumps multiple times per hour: Replication would probably be the best solution-perhaps Slony. Occasionaly or small volume: A Perl script / cron job that executes a SELECT * FROM x WHERE date > $passed parameter when calling the script. One time: Use pgadminIII or psql to execute a SELECT query and direct the results into a file. Mike On Wed, 2004-06-30 at 07:07, h_harush@hotmail.com wrote: > Hi, > > I need to dump only partial content of my database, for example i want > to dump only records that has been insterted to the database from a > specific date. > I tried to use pg_dump/pg_export but did not find anything usefull. > > I'm using postgres version 7.3 on Linux RH 7.3 > > any idea/direction ? > > Regards, > Hanan > > ---------------------------(end of broadcast)--------------------------- > TIP 4: Don't 'kill -9' the postmaster
Just wondering--is it possible to dump on a temporary table? Cheryl Bender -----Original Message----- From: pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-owner@postgresql.org] On Behalf Of mike g Sent: Thursday, July 01, 2004 11:11 PM To: h_harush@hotmail.com Cc: pgsql-admin@postgresql.org Subject: Re: [ADMIN] Dumping partial database content I don't believe there is an option in pg_dump that current handles that. It is the whole table / object or nothing at all. Depending on the volume of transactions and frequency that you need to dump the data will determine which solution works best for you. Heavy volume and/or dumps multiple times per hour: Replication would probably be the best solution-perhaps Slony. Occasionaly or small volume: A Perl script / cron job that executes a SELECT * FROM x WHERE date > $passed parameter when calling the script. One time: Use pgadminIII or psql to execute a SELECT query and direct the results into a file. Mike On Wed, 2004-06-30 at 07:07, h_harush@hotmail.com wrote: > Hi, > > I need to dump only partial content of my database, for example i want > to dump only records that has been insterted to the database from a > specific date. I tried to use pg_dump/pg_export but did not find > anything usefull. > > I'm using postgres version 7.3 on Linux RH 7.3 > > any idea/direction ? > > Regards, > Hanan > > ---------------------------(end of > broadcast)--------------------------- > TIP 4: Don't 'kill -9' the postmaster ---------------------------(end of broadcast)--------------------------- TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org
Never mind--answered my own question. You can dump from a temporary table, which provides Hanan another way to dump a subset of data. Use CREATE TEMPORARY TABLE as select .... Cheryl Bender -----Original Message----- From: pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Bender, Cheryl Sent: Friday, July 02, 2004 11:48 AM To: mike@thegodshalls.com; h_harush@hotmail.com Cc: pgsql-admin@postgresql.org Subject: Re: [ADMIN] Dumping partial database content Just wondering--is it possible to dump on a temporary table? Cheryl Bender -----Original Message----- From: pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-owner@postgresql.org] On Behalf Of mike g Sent: Thursday, July 01, 2004 11:11 PM To: h_harush@hotmail.com Cc: pgsql-admin@postgresql.org Subject: Re: [ADMIN] Dumping partial database content I don't believe there is an option in pg_dump that current handles that. It is the whole table / object or nothing at all. Depending on the volume of transactions and frequency that you need to dump the data will determine which solution works best for you. Heavy volume and/or dumps multiple times per hour: Replication would probably be the best solution-perhaps Slony. Occasionaly or small volume: A Perl script / cron job that executes a SELECT * FROM x WHERE date > $passed parameter when calling the script. One time: Use pgadminIII or psql to execute a SELECT query and direct the results into a file. Mike On Wed, 2004-06-30 at 07:07, h_harush@hotmail.com wrote: > Hi, > > I need to dump only partial content of my database, for example i want > to dump only records that has been insterted to the database from a > specific date. I tried to use pg_dump/pg_export but did not find > anything usefull. > > I'm using postgres version 7.3 on Linux RH 7.3 > > any idea/direction ? > > Regards, > Hanan > > ---------------------------(end of > broadcast)--------------------------- > TIP 4: Don't 'kill -9' the postmaster ---------------------------(end of broadcast)--------------------------- TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org ---------------------------(end of broadcast)--------------------------- TIP 4: Don't 'kill -9' the postmaster
Martha Stewart called it a Good Thing when cbender@mriresearch.org ("Bender, Cheryl") wrote:
> Just wondering--is it possible to dump on a temporary table?
The temp table is only visible inside the context of the transaction
under which it was created.
A pg_dump session will create an independent transaction context,
where the table won't be visible, alas.
So you can't use pg_dump to dump the data out.
You may, however, use COPY to dump it out yourself.
select * into temp table foo from bar;
copy foo to '/tmp/foo_contents.txt';
--
If this was helpful, <http://svcs.affero.net/rm.php?r=cbbrowne> rate me
http://www.ntlug.org/~cbbrowne/postgresql.html
Rules of the Evil Overlord #50. "My main computers will have their own
special operating system that will be completely incompatible with
standard IBM and Macintosh powerbooks."
<http://www.eviloverlord.com/>
I see what you're saying. I thought it had worked, but when I looked at
the dump file there was no data. Thanks.
Cheryl Bender
-----Original Message-----
From: pgsql-admin-owner@postgresql.org
[mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Christopher
Browne
Sent: Friday, July 02, 2004 2:15 PM
To: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] Dumping partial database content
Martha Stewart called it a Good Thing when cbender@mriresearch.org
("Bender, Cheryl") wrote:
> Just wondering--is it possible to dump on a temporary table?
The temp table is only visible inside the context of the transaction
under which it was created.
A pg_dump session will create an independent transaction context, where
the table won't be visible, alas.
So you can't use pg_dump to dump the data out.
You may, however, use COPY to dump it out yourself.
select * into temp table foo from bar;
copy foo to '/tmp/foo_contents.txt';
--
If this was helpful, <http://svcs.affero.net/rm.php?r=cbbrowne> rate me
http://www.ntlug.org/~cbbrowne/postgresql.html
Rules of the Evil Overlord #50. "My main computers will have their own
special operating system that will be completely incompatible with
standard IBM and Macintosh powerbooks." <http://www.eviloverlord.com/>
---------------------------(end of broadcast)---------------------------
TIP 6: Have you searched our list archives?
http://archives.postgresql.org