Re: pg_dump resulting in excessive memory use by postmaster process - Mailing list pgsql-general

From Ben
Subject Re: pg_dump resulting in excessive memory use by postmaster process
Date
Msg-id 010a01cece78$f9ccf7c0$ed66e740$@champsoftware.com
Whole thread Raw
In response to Re: pg_dump resulting in excessive memory use by postmaster process  (Stephen Frost <sfrost@snowman.net>)
Responses Re: pg_dump resulting in excessive memory use by postmaster process  (Stephen Frost <sfrost@snowman.net>)
List pgsql-general
When you say self-contained test case, what is it exactly that you're
looking for? A script that builds out a DB with hundreds of
schemas/relations, a pg_basebackup or something else?

Thanks!

Ben

-----Original Message-----
From: pgsql-general-owner@postgresql.org
[mailto:pgsql-general-owner@postgresql.org] On Behalf Of Stephen Frost
Sent: Monday, October 21, 2013 10:37 AM
To: Ben
Cc: 'PG-General Mailing List'
Subject: Re: [GENERAL] pg_dump resulting in excessive memory use by
postmaster process

* Ben (ben.fyvie@champsoftware.com) wrote:
> is killed off (6GB+ used by a single postmaster process).  Here are
> the
[...]
> Total number of relations across all schemas: 53,154
[...]
> I should also mention that when performing these dumps there is
> absolutely no other DB activity occurring. Do you have any ideas why
> the excessive memory growth on the postmaster service is occurring when
doing a pg_dump?

At first blush, I'm suspicious of the system catalog cache which is going to
want to get every bit of attribute for every relation involved and it looks
like you've got quite a few here.

It seems like something which we could/should improve upon, but I'm not sure
who/what/when/where/how it'll get better.

Still, would it be possible for you to provide a self-contained test case
which shows this, so we can look at what's happening exactly and verify
where the fault lies?

    Thanks,

        Stephen



pgsql-general by date:

Previous
From: Ian Lawrence Barwick
Date:
Subject: Re: Preserving the source code of views
Next
From: Stephen Frost
Date:
Subject: Re: pg_dump resulting in excessive memory use by postmaster process