All,
> The easiest place to start is by re-using the work already done by the
> TPC for benchmarking commercial databases. There are ports of the TPC
> workloads to PostgreSQL available in the DBT-2, DBT-3, and DBT-5
> tests;
Also EAStress, which I think the project still has a license for.
The drawback to these is that they're quite difficult and time-consuming to run, making them unsuitable for doing, say,
incrementaltuning tests which need to run 100 iterations. At least, now that we don't have access to the OSDL or Sun
labsanymore.
On the other hand, Greg has made the first steps in a benchmark constructor kit by making it possible for pgBench to
runarbitrary workloads. Someone could build on Greg's foundation by:
a) building a more complex database model with random data generators, and
b) designing a wide series of queries designed to test specific performance problems, i.e, "large object reads",
"complexnested subqueries", "mass bulk correllated updates"
c) finally creating scripts which generate benchmarks by choosing a database size and a "mix" of the query menu
This would give us kit which would be capable of testing performance regressions and improvements for PostgreSQL.
--
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com
San Francisco
