Re: pg_restore enhancements - Mailing list pgsql-general

From Tom Lane
Subject Re: pg_restore enhancements
Date
Msg-id 2298671.1700681272@sss.pgh.pa.us
Whole thread Raw
In response to Re: pg_restore enhancements  ("Efrain J. Berdecia" <ejberdecia@yahoo.com>)
Responses Re: pg_restore enhancements
List pgsql-general
"Efrain J. Berdecia" <ejberdecia@yahoo.com> writes:
> Thanks, the issue we've run into, which I guess could be really a setup issue, with running a COPY command while
executingpg_restore, is that if we are restoring a large table (bigger than 500GB) our WAL directory can grow to be
verylarge. 
> I would think that if the pg_restore or COPY command was able to support a batch-size option, this should allow
postgresto either archive or remove wal files and prevent having to re-size the WAL directory for a one time refresh
operation.
> I'm trying to gage how feasible would be to start looking at contributing to add such a feature to either the COPY
commandor pg_restore. 

Given the shortage of other complaints, I tend to agree with Adrian
that there's not likely to be much interest in adding complexity
to pg_restore (or COPY) to address this.  You should probably look
harder at the idea that you have some configuration problem that's
triggering your WAL bloat.  If COPY can run you out of WAL space,
then so could any future bulk insert or update.

            regards, tom lane



pgsql-general by date:

Previous
From: Adrian Klaver
Date:
Subject: Re: strange behavior of pg_hba.conf file
Next
From: Ron Johnson
Date:
Subject: Re: pg_restore enhancements