Thread: database Benchmark, TPC, PostgreSQL and TPC-E
Looking for database benchmarks I fell into the Transaction Processing Performance Council Some questions on it. are there somewhere some results of TPC-* benchmarks for PostgreSQL? Are there reliable database tests? There are open source implementation? There are other benchmarks that would be worth to consider to use, or implement? Looking on the TPC-E 1.10.0 specification history I saw that Enterprise DB has quitted the membership list (14 march 2008) What does it mean for PostgreSQL? thank you Davide
On 5/5/2010 2:56 AM, williamkidd@libero.it wrote: > Looking for database benchmarks I fell into the Transaction Processing > Performance Council > > Some questions on it. > > are there somewhere some results of TPC-* benchmarks for PostgreSQL? > Are there reliable database tests? There are open source implementation? > There are other benchmarks that would be worth to consider to use, or > implement? > Looking on the TPC-E 1.10.0 specification history I saw that Enterprise DB has > quitted the membership list (14 march 2008) > What does it mean for PostgreSQL? > > thank you > > Davide > > I think TPC is a measure of how much money a company will spend to be listed as #1. I doubt you'll find PG because you have to pay mucho $$$ to setup/run/publish TPC results. Really, though, the best benchmark you can run, is your own workload. Different benchmarks are setup to test different things. Your workload may resemble one of them closely, in which case you are in luck... but otherwise those benchmarks wont tell you much about your own workload. There is a lot of talk about benchmarks in the mailing lists... I've not read this one, but seems to match: http://www.mail-archive.com/pgsql-general@postgresql.org/msg128869.html -Andy
williamkidd@libero.it wrote: > are there somewhere some results of TPC-* benchmarks for PostgreSQL? > Are there reliable database tests? There are open source implementation? > There are other benchmarks that would be worth to consider to use, or > implement? > There's a bunch of information on this topic at http://wiki.postgresql.org/wiki/Category:Benchmarking ; the entries for DBT-{2,3,5} are open source implementations of some of those. And the links at the top there point to info about the sole audited PostgreSQL benchmark I'm aware of, which is a SPEC result rather than a TPC one. > Looking on the TPC-E 1.10.0 specification history I saw that Enterprise DB has > quitted the membership list (14 march 2008) > What does it mean for PostgreSQL? > Official TPC results require spending a lot of money, from buying servers to having the results audited, and there's very little value received for that expense from the perspective of the PostgreSQL community. The fact that the software is free doesn't quite fit into the whole performance/$ focus of what real TPC results deliver. TPC-H is the most interesting of them to me (and that's where there's a detailed page linking to resources related to it) because it suggests types of queries the database could handle better than it does right now. -- Greg Smith 2ndQuadrant US Baltimore, MD PostgreSQL Training, Services and Support greg@2ndQuadrant.com www.2ndQuadrant.us