Re: stale WAL files? - Mailing list pgsql-general

From Rob Sargent
Subject Re: stale WAL files?
Date
Msg-id 04f4bc5d-be30-c1da-4d5c-db0f71b20324@gmail.com
Whole thread Raw
In response to Re: stale WAL files?  (Rene Romero Benavides <rene.romero.b@gmail.com>)
Responses Re: stale WAL files?
List pgsql-general



As per your configuration :
max_wal_size = 50GB
this seems to be the cause for the WAL files piling up.

this has been declared twice, the last one is taking effect.
--
El genio es 1% inspiración y 99% transpiración.
Thomas Alva Edison
http://pglearn.blogspot.mx/

I've manage to generate another 359 WAL files in a 10 minute span yesterday (now only 357 remain and I suspect they will wither away as before).  Are these being held simply because of the high max_wal_size value?

This is a development environment, wherein I'm loading 4M+ records, first into 41 staging tables 100K rows per.  In a loop over each staging table, the data is then placed into application tables via selects. First select * into "matching table" then select id into intersection record (id, fixed groupId).  Each such iteration is in it's own transaction.  I have dropped and recreate this same database numerous times working my way up from 100K to 4M records, dialing in application parameters according to number of primary records.  I have not, however, dropped the last incarnation.

pgsql-general by date:

Previous
From: Thomas Kellerer
Date:
Subject: Re: pg_indexes doesn't show indexes for partitioned tables - bug orintended?
Next
From: Michel Pelletier
Date:
Subject: Re: How to use full-text search URL parser to filter query results bydomain name?