Re: WIP/PoC for parallel backup - Mailing list pgsql-hackers

From Robert Haas
Subject Re: WIP/PoC for parallel backup
Date
Msg-id CA+Tgmobx=97uFjP5eRuDxLhGDsQ63ws6=9PE=SORuUaKa=w1aQ@mail.gmail.com
Whole thread Raw
In response to Re: WIP/PoC for parallel backup  (Kashif Zeeshan <kashif.zeeshan@enterprisedb.com>)
Responses Re: WIP/PoC for parallel backup
List pgsql-hackers
On Thu, Apr 2, 2020 at 7:30 AM Kashif Zeeshan <kashif.zeeshan@enterprisedb.com> wrote:
The backup failed with errors "error: could not connect to server: could not look up local user ID 1000: Too many open files" when the max_wal_senders was set to 2000. 
The errors generated for the workers starting from backup worke=1017.

It wasn't the fact that you set max_wal_senders to 2000. It was the fact that you specified 1990 parallel workers. By so doing, you overloaded the machine, which is why everything failed. That's to be expected.

--
Robert Haas
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company

pgsql-hackers by date:

Previous
From: Robert Haas
Date:
Subject: Re: WIP/PoC for parallel backup
Next
From: Kashif Zeeshan
Date:
Subject: Re: WIP/PoC for parallel backup