Thread: Benchmarking PostgreSQL

Benchmarking PostgreSQL

From
Justin Clift
Date:
Hi all,

I'm looking to run some benchmarks of PostgreSQL on some of the Linux systems
here.  They're running PostgreSQL 7.0.3, and I've compiled and installed
PostgreSQL 7.1RC4 on one as well.

Does anyone have suggestions for the best way to do benchmarks (even of a
limited scale) on these systems, so I can at least determine what the optimum
buffer sizes are, etc?

As an aside, did anyone ever step up to create a TPC-C benchmark suite for
PostgreSQL?

If no-one else has, I will start to.

Regards and best wishes,

Justin Clift

Re: Benchmarking PostgreSQL

From
Ned Lilly
Date:
Justin Clift wrote:

> As an aside, did anyone ever step up to create a TPC-C benchmark suite for
> PostgreSQL?

Part of the Great Bridge QA process (on every beta, every community major and
minor release, and certainly any release we distribute on CD) is the running of
the TPC tests and the AS3AP, as implemented by Quest Software's Benchmark Factory
(free trial available at http://www.quest.com/benchmark_factory/).  These were
the tests we originally ran last year as part of our due diligence in evaluating
Postgres before forming the company - it's now part of our regular process.

Don't know of any other widely-available implementations besides Quest's, but
some engineers in the Alpha group at Compaq had done some work on an open source
implementation of the AS3AP ... don't have the URL handy, but you ought to be
able to find it in the archives.

Regards,
Ned

--
----------------------------------------------------
Ned Lilly                     e: ned@greatbridge.com
Vice President                w: www.greatbridge.com
Evangelism / Hacker Relations        v: 757.233.5523
Great Bridge, LLC                    f: 757.233.5555



Re: Benchmarking PostgreSQL

From
"Dominic J. Eidson"
Date:
On Fri, 13 Apr 2001, Ned Lilly wrote:
> Justin Clift wrote:
> > As an aside, did anyone ever step up to create a TPC-C benchmark suite for
> > PostgreSQL?
>
> Part of the Great Bridge QA process (on every beta, every community
> major and minor release, and certainly any release we distribute on
> CD) is the running of the TPC tests and the AS3AP, as implemented by
> Quest Software's Benchmark Factory (free trial available at
> http://www.quest.com/benchmark_factory/).  These were the tests we
> originally ran last year as part of our due diligence in evaluating
> Postgres before forming the company - it's now part of our regular
> process.

Are these test results (I'd be happy with the raw numbers) available to
the public anywhere?


--
Dominic J. Eidson
                                        "Baruk Khazad! Khazad ai-menu!" - Gimli
-------------------------------------------------------------------------------
http://www.the-infinite.org/              http://www.the-infinite.org/~dominic/


Re: Benchmarking PostgreSQL

From
Ned Lilly
Date:
Yes - http://www.greatbridge.com/about/press.php?content_id=4

Regards,
Ned


"Dominic J. Eidson" wrote:

> On Fri, 13 Apr 2001, Ned Lilly wrote:
> > Justin Clift wrote:
> > > As an aside, did anyone ever step up to create a TPC-C benchmark suite for
> > > PostgreSQL?
> >
> > Part of the Great Bridge QA process (on every beta, every community
> > major and minor release, and certainly any release we distribute on
> > CD) is the running of the TPC tests and the AS3AP, as implemented by
> > Quest Software's Benchmark Factory (free trial available at
> > http://www.quest.com/benchmark_factory/).  These were the tests we
> > originally ran last year as part of our due diligence in evaluating
> > Postgres before forming the company - it's now part of our regular
> > process.
>
> Are these test results (I'd be happy with the raw numbers) available to
> the public anywhere?
>
> --
> Dominic J. Eidson
>                                         "Baruk Khazad! Khazad ai-menu!" - Gimli
> -------------------------------------------------------------------------------
> http://www.the-infinite.org/              http://www.the-infinite.org/~dominic/

--
----------------------------------------------------
Ned Lilly                     e: ned@greatbridge.com
Vice President                w: www.greatbridge.com
Evangelism / Hacker Relations        v: 757.233.5523
Great Bridge, LLC                    f: 757.233.5555



RE: Benchmarking PostgreSQL

From
"Riebs, Andy"
Date:
Ned Lilly wrote:

> Don't know of any other widely-available implementations
> besides Quest's, but some engineers in the Alpha group at
> Compaq had done some work on an open source
> implementation of the AS3AP ... don't have the URL handy, but
> you ought to be able to find it in the archives.

You can find it at <http://osdb.sourceforge.net> (the "Open Source
Database Benchmark").

(I've been warned that we need to modify it for v7.1 -- I guess the
time has come!)

/andy

---
Andy Riebs, andy.riebs@compaq.com      Alpha Technology Solutions Group
978-506-6628, fax 978-506-6524         Compaq Computer Corporation
(h) ariebs@earthlink.net
<http://www.linuxalpha.compaq.com>
<http://osdb.sourceforge.net/>