Re: unexpected external sort Disk - Mailing list pgsql-general

From Jeff Janes
Subject Re: unexpected external sort Disk
Date
Msg-id CAMkU=1w2y87NJueqwN8-HK2KDb4UOihFAJXpO1NZ3EkHZvBmmQ@mail.gmail.com
Whole thread Raw
In response to unexpected external sort Disk  (Manuel Kniep <rapimo@adeven.com>)
List pgsql-general
On Thu, Jun 20, 2013 at 6:12 AM, Manuel Kniep <rapimo@adeven.com> wrote:
Hello,

I have table with 37 million entries the whole table has a size of  2.3 GB

Although I have set the work_mem to 10 GB


There is one piece of memory used in in-memory sorting that (currently) has to be a single contiguous allocation, and that piece is limited to 1GB.  This means you can't always use the entire amount of work_mem declared, especially when sorting a very large number of very short rows, as you seem to be doing.

There is another "rounding" issue that means sometimes as little as 512MB of that 1GB is actually used.  This part is probably fixed for 9.3.


Cheers,

Jeff

pgsql-general by date:

Previous
From: Jeff Janes
Date:
Subject: Re: Do not understand high estimates of index scan vs seq scan
Next
From: Alban Hertroys
Date:
Subject: Re: Exporting Data