Re: How to improve db performance with $7K? - Mailing list pgsql-performance

From Greg Stark
Subject Re: How to improve db performance with $7K?
Date
Msg-id 87d5sxgrrg.fsf@stark.xeocode.com
Whole thread Raw
In response to Re: How to improve db performance with $7K?  (Kevin Brown <kevin@sysexperts.com>)
List pgsql-performance
Kevin Brown <kevin@sysexperts.com> writes:

> Greg Stark wrote:
>
>
> > I think you're being misled by analyzing the write case.
> >
> > Consider the read case. When a user process requests a block and
> > that read makes its way down to the driver level, the driver can't
> > just put it aside and wait until it's convenient. It has to go ahead
> > and issue the read right away.
>
> Well, strictly speaking it doesn't *have* to.  It could delay for a
> couple of milliseconds to see if other requests come in, and then
> issue the read if none do.  If there are already other requests being
> fulfilled, then it'll schedule the request in question just like the
> rest.

But then the cure is worse than the disease. You're basically describing
exactly what does happen anyways, only you're delaying more requests than
necessary. That intervening time isn't really idle, it's filled with all the
requests that were delayed during the previous large seek...

> Once the first request has been fulfilled, the driver can now schedule
> the rest of the queued-up requests in disk-layout order.
>
> I really don't see how this is any different between a system that has
> tagged queueing to the disks and one that doesn't.  The only
> difference is where the queueing happens.

And *when* it happens. Instead of being able to issue requests while a large
seek is happening and having some of them satisfied they have to wait until
that seek is finished and get acted on during the next large seek.

If my theory is correct then I would expect bandwidth to be essentially
equivalent but the latency on SATA drives to be increased by about 50% of the
average seek time. Ie, while a busy SCSI drive can satisfy most requests in
about 10ms a busy SATA drive would satisfy most requests in 15ms. (add to that
that 10k RPM and 15kRPM SCSI drives have even lower seek times and no such
IDE/SATA drives exist...)

In reality higher latency feeds into a system feedback loop causing your
application to run slower causing bandwidth demands to be lower as well. It's
often hard to distinguish root causes from symptoms when optimizing complex
systems.

--
greg

pgsql-performance by date:

Previous
From: Greg Stark
Date:
Subject: Re: How to improve db performance with $7K?
Next
From: Greg Stark
Date:
Subject: Re: recovery after long delete