Re: Constantly increasing per connection memory usage on pg 9.2 - Mailing list pgsql-general

From Eliott
Subject Re: Constantly increasing per connection memory usage on pg 9.2
Date
Msg-id 52AEFDA7.4010900@gmail.com
Whole thread Raw
In response to Re: Constantly increasing per connection memory usage on pg 9.2  (Jeff Janes <jeff.janes@gmail.com>)
Responses Re: Constantly increasing per connection memory usage on pg 9.2  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-general
Hi!

I'd like to revisit this issue. What we have noticed that the amount of memory increase does not really depend on the number of large queries, but the number of queries in general.

So, can anybody confirm that is is normal for a 9.2 based server connection to take up 10 times the connection specific memory that 8.3 used to need? It seems like that difference is in the (RES-SHR) value. For 8.2 it is just a few megs, however, in case of 9.2 the non shared resident portion is 60, sometimes maybe even 100 mb per connection.

regards
eliott

On 2013.12.07. 21:53, Jeff Janes wrote:
On Sat, Dec 7, 2013 at 1:10 AM, Eliott <eliott100@gmail.com> wrote:
Dear Community,

we've recently moved one of our production databases from a 8.3 based server to a 9.2 installation. Our usage patterns remained the same, however, we noticed that the swap space in the server started to decrease with time.

We have roughly 16 connections to this database in an almost constant basis, pooled by a java connection pooler on the app side. This connections never expire (nor did they do with the 8.3 db).
However,  as you can see on this memory usage chart http://i.imgur.com/2sRRj1J.png it shows a rolleccoaster like pattern. When we restart our application, the connections are closed and the memory is freed.

Our work_mem is 2MB, so it does not warrant the large memory allocation. Also I am completely sure that this is the pg connection process that's eating up the memory.

Is it the process on the client side or the server side that is using the memory?

How many tables are in the database?  Every additional table touched will pull in some more metadata, so over the course of a long lived connection in the pool, it could grow a lot if you have a lot of tables.

Cheers,

Jeff 

pgsql-general by date:

Previous
From: Tom Lane
Date:
Subject: Re: pg_dump behaves differently for different archive formats
Next
From: Tom Lane
Date:
Subject: Re: Constantly increasing per connection memory usage on pg 9.2