Re: select on 22 GB table causes "An I/O error occured while sending to the backend." exception - Mailing list pgsql-performance

From Craig James
Subject Re: select on 22 GB table causes "An I/O error occured while sending to the backend." exception
Date
Msg-id 48B6EA7E.2090707@emolecules.com
Whole thread Raw
In response to Re: select on 22 GB table causes "An I/O error occured while sending to the backend." exception  (Matthew Wakeling <matthew@flymine.org>)
Responses Re: select on 22 GB table causes "An I/O error occured while sending to the backend." exception  (david@lang.hm)
Re: select on 22 GB table causes "An I/O error occured while sending to the backend." exception  (Matthew Wakeling <matthew@flymine.org>)
Re: select on 22 GB table causes "An I/O error occured while sending to the backend." exception  (Florian Weimer <fweimer@bfk.de>)
List pgsql-performance
Matthew Wakeling wrote:
> On Thu, 28 Aug 2008, Steve Atkins wrote:
>>> Probably the best solution is to just tell the kernel somehow to
>>> never kill the postmaster.
>>
>> Or configure adequate swap space?
>
> Oh yes, that's very important. However, that gives the machine the
> opportunity to thrash.

No, that's where the whole argument for allowing overcommitted memory falls flat.

The entire argument for allowing overcommitted memory hinges on the fact that processes *won't use the memory*.  If
theyuse it, then overcommitting causes problems everywhere, such as a Postmaster getting arbitrarily killed. 

If a process *doesn't* use the memory, then there's no problem with thrashing, right?

So it never makes sense to enable overcommitted memory when Postgres, or any server, is running.

Allocating a big, fat terabyte swap disk is ALWAYS better than allowing overcommitted memory.  If your usage is such
thatovercommitted memory would never be used, then the swap disk will never be used either.  If your processes do use
thememory, then your performance goes into the toilet, and you know it's time to buy more memory or a second server,
butin the mean time your server processes at least keep running while you kill the rogue processes. 

Craig

pgsql-performance by date:

Previous
From: Jeff Davis
Date:
Subject: Re: select on 22 GB table causes "An I/O error occured while sending to the backend." exception
Next
From: david@lang.hm
Date:
Subject: Re: select on 22 GB table causes "An I/O error occured while sending to the backend." exception