Re: Purpose of pg_dump tar archive format? - Mailing list pgsql-general

From Ron Johnson
Subject Re: Purpose of pg_dump tar archive format?
Date
Msg-id CANzqJaDonyXAvPpNi5ZX3WUrCCxXfPHAzOKqab29Zq-WZ5UEaQ@mail.gmail.com
Whole thread Raw
In response to Re: Purpose of pg_dump tar archive format?  (Gavin Roy <gavinr@aweber.com>)
Responses Re: Purpose of pg_dump tar archive format?
List pgsql-general
On Tue, Jun 4, 2024 at 3:47 PM Gavin Roy <gavinr@aweber.com> wrote:

On Tue, Jun 4, 2024 at 3:15 PM Ron Johnson <ronljohnsonjr@gmail.com> wrote:

But why tar instead of custom? That was part of my original question.

I've found it pretty useful for programmatically accessing data in a dump for large databases outside of the normal pg_dump/pg_restore workflow. You don't have to seek through one large binary file to get to the data section to get at the data.

Interesting.  Please explain, though, since a big tarball _is_ "one large binary file" that you have to sequentially scan.  (I don't know the internal structure of custom format files, and whether they have file pointers to each table.)

Is it because you need individual .dat "COPY" files for something other than loading into PG tables (since pg_restore --table=xxxx does that, too), and directory format archives can be inconvenient?

pgsql-general by date:

Previous
From: Adrian Klaver
Date:
Subject: Re: Questions on logical replication
Next
From: sud
Date:
Subject: Re: Long running query causing XID limit breach