Re: Maximum transaction rate - Mailing list pgsql-general

From Stefan Kaltenbrunner
Subject Re: Maximum transaction rate
Date
Msg-id 49BEB075.6000400@kaltenbrunner.cc
Whole thread Raw
In response to Re: Maximum transaction rate  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: Maximum transaction rate  (Scott Marlowe <scott.marlowe@gmail.com>)
Re: Maximum transaction rate  (John R Pierce <pierce@hogranch.com>)
List pgsql-general
Tom Lane wrote:
> Jack Orenstein <jack.orenstein@hds.com> writes:
>> The transaction rates I'm getting seem way too high: 2800-2900 with
>> one thread, 5000-7000 with ten threads. I'm guessing that writes
>> aren't really reaching the disk. Can someone suggest how to figure out
>> where, below postgres, someone is lying about writes reaching the
>> disk?
>
> AFAIK there are two trouble sources in recent Linux machines: LVM and
> the disk drive itself.  LVM is apparently broken by design --- it simply
> fails to pass fsync requests.  If you're using it you have to stop.
> (Which sucks, because it's exactly the kind of thing DBAs tend to want.)
> Otherwise you need to reconfigure your drive to not cache writes.
> I forget the incantation for that but it's in the PG list archives.

hmm are you sure this is what is happening?
In my understanding LVM is not passing down barriers(generally - it
seems to do in some limited circumstances) which means in my
understanding it is not safe on any storage drive that has write cache
enabled. This seems to be the very same issue like linux had for ages
before ext3 got barrier support(not sure if even today all filesystems
do have that).
So in my understanding LVM is safe on disks that have write cache
disabled or "behave" as one (like a controller with a battery backed cache).
For storage with write caches it seems to be unsafe, even if the
filesystem supports barriers and it has them enabled (which I don't
think all have) which is basically what all of linux was not too long ago.


Stefan

pgsql-general by date:

Previous
From: "Kostadin Solakov"
Date:
Subject: Re: PostgreSQL on Webmin
Next
From: Stefan Kaltenbrunner
Date:
Subject: Re: deployment query