Re: Postgres benchmarking with pgbench - Mailing list pgsql-performance

From Scott Marlowe
Subject Re: Postgres benchmarking with pgbench
Date
Msg-id dcc563d10903162233ta0b6517m6793d6c74a8418f2@mail.gmail.com
Whole thread Raw
In response to Re: Postgres benchmarking with pgbench  (Greg Smith <gsmith@gregsmith.com>)
List pgsql-performance
On Mon, Mar 16, 2009 at 10:17 PM, Greg Smith <gsmith@gregsmith.com> wrote:
> On Tue, 17 Mar 2009, Gregory Stark wrote:
>
>> I think pgbench is just not that great a model for real-world usage
>
> pgbench's default workload isn't a good model for anything.  It wasn't a
> particularly real-world test when the TPC-B it's based on was created, and
> that was way back in 1990.  And pgbench isn't even a good implementation of
> that spec (the rows are too narrow, comments about that in pgbench.c).
>
> At this point, the only good thing you can say about pgbench is that it's
> been a useful tool for comparing successive releases of PostgreSQL in a
> relatively fair way.  Basically, it measures what pgbench measures, and that
> has only a loose relationship with what people want a database to do.

I'd say pgbench is best in negative.  I.e it can't tell you a database
server is gonna be fast, but it can usually tell you when something's
horrifically wrong.  If I just installed a new external storage array
of some kind and I'm getting 6 tps, something is wrong somewhere.

And it's good for exercising your disk farm for a week during burn in.
 It certainly turned up a bad RAID card last fall during acceptance
testing our new servers.  Took 36 hours of pgbench to trip the bug and
cause the card to lock up.  Had one bad disk drive too that pgbench
killed of for me.

pgsql-performance by date:

Previous
From: Greg Smith
Date:
Subject: Re: High CPU Utilization
Next
From: Simon Riggs
Date:
Subject: Re: Proposal of tunable fix for scalability of 8.4