On Tuesday 16 December 2008 15:58:15 Peter Eisentraut wrote:
> On Monday 15 December 2008 23:56:08 Jonah H. Harris wrote:
> > On Mon, Dec 15, 2008 at 3:26 PM, Josh Berkus <josh@agliodbs.com> wrote:
> > > You can't compare DBT2 with TPCC. They're not the same benchmark.
> >
> > Agreed. Somewhere earlier in the thread I mentioned that the OSDL
> > kits are non-spec-compliant, a little buggy, and sometimes give better
> > results than the real tests.
>
> Could we consolidate everyone's concerns into a project outline, if one is
> necessary?
>
> - Everyone would like to have a TPC-like benchmark kit.
> - OSDL script are not compliant.
> - OSDL scripts are outdated/appear unmaintained.
> - OSDL scripts need POstgreSQL-specific improvements.
> - EnterpriseDB is apparently maintaining their own fork.
>
Don't forget Jan's TPC-W benchmark, available at
http://pgfoundry.org/projects/tpc-w-php/. Not sure if it still works, but Jan
claims it did at one point.
--
Robert Treat
Conjecture: http://www.xzilla.net
Consulting: http://www.omniti.com
