Re: Out of shared memory while creating a backup with pg_dump - Mailing list pgsql-admin

From Shreeyansh dba
Subject Re: Out of shared memory while creating a backup with pg_dump
Date
Msg-id CAGDYbUO1xEuvSvkE71fm8BSoUOfaoaWjS+N5jo6rXuLh-CzP4Q@mail.gmail.com
Whole thread Raw
In response to Out of shared memory while creating a backup with pg_dump  (<christian.echerer@manroland-web.com>)
List pgsql-admin


On Wed, Sep 24, 2014 at 2:35 PM, <christian.echerer@manroland-web.com> wrote:
Hi,

while creating a backup with pg_dump and parallel write accesses to the database following error occured:
2014-09-24 07:46:46 ... ERROR:  out of shared memory
2014-09-24 07:46:46 ... HINT:  You might need to increase max_pred_locks_per_transaction.

I´m running postgresql 9.3.4 on Ubuntu 12.04 server. The server has 8GB RAM and 4 cores.
/proc/sys/kernel/shmmax: 2147483648
/proc/sys/kernel/shmall: 2097152

The original configuration was changed in only a few relevant points:
* shared_buffers = 128MB
* work_mem = 10MB

We run a hot standby slave, therefore the following changes were necessary:
* wal_level = hot_standby
* max_wal_senders = 1
* wal_keep_segments = 64
* hot_standby = on
* hot_standby_feedback = on


I didn´t understand the HINT:
You might need to increase max_pred_locks_per_transaction.

What is the reason for the error, that the shared memory ran out, or that the number of predicate locks is too small?
If i increase max_pred_locks_per_transaction i get probably even faster an "out of shared memory" error.

What is the best way to fix the problem?

The database consists of approximately 150 tables and is about 140GB in size. Where one table with 130 GB (~280000000 rows) requires the most space.

Please help me to troubleshoot this severe problem. I will feedback any required information.

Thanks in advance
Christian



I suspect that this kind of errors occur due to less size of shared_buffer,work_mem and maintenance_work_mem.
Solution to resolve this kind of errors , by increasing the size of shared_buffers ,work_mem  and maintenance_work_mem.
As your RAM is 8 GB , try to perform base-backup by setting the parameters in postgresql.conf as given shared_buffers=(app 1GB to 2GB),work_mem=512MB,maintenance_work_mem=512MB.

This might resolve your issue of pg_basebackup.


Regards,
Chetan Sharma,






 
______________
manroland web systems GmbH -- Managing Director: Joern Gossé
Registered Office: Augsburg -- Trade Register: AG Augsburg -- HRB-No.: 26816 -- VAT: DE281389840

Confidentiality note:
This eMail and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient, you are hereby notified that any use or dissemination of this communication is strictly prohibited. If you have received this eMail in error, then please delete this eMail.

! Please consider your environmental responsibility before printing this eMail !
________________________________


--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin

pgsql-admin by date:

Previous
From:
Date:
Subject: Out of shared memory while creating a backup with pg_dump
Next
From: Raghu Ram
Date:
Subject: Re: Out of shared memory while creating a backup with pg_dump