Thread: (download ANSI SQL benchmark?) Re: Postgres article
This's great. I have tested Postgres and MySQL with the benchmark shipped with mysql and (of course) MySQL out perform Postgres.
I wonder does anyone know where can we download the ANSI SQL benchmark (AN3AP) suite? I'd like to run this benchmark test myself, since this is the only benchmark I have read so far that Postgres out perform MySQL.
Thanx in advance.
>
> Did someone read bout this?
>
> http://www.angelfire.com/nv/aldev/pgsql/GreatBridge.html
>
-- Limin Liu
(bcc to -hackers) The Benchmark Factory software, recently acquired by Quest Software, can be downloaded for a 30-day trial (limited # of users) at: http://www.benchmarkfactory.com/emaildatabase/FormBenchmarkFactoryTrial.asp?product=BenchmarkFactory (note long URL above might have wrapped) That's the package we used - also the one that eWeek (formerly PCWeek) and other trade magazines use. See http://www.greatbridge.com/about/press.php?content_id=4 for more info on how we conducted the test. Regards, Ned Limin Liu wrote: > This's great. I have tested Postgres and MySQL with the benchmark > shipped with mysql and (of course) MySQL out perform Postgres. > > I wonder does anyone know where can we download the ANSI SQL > benchmark (AN3AP) suite? I'd like to run this benchmark test > myself, since this is the only benchmark I have read so far that > Postgres out perform MySQL. > > Thanx in advance. > > > > > Did someone read bout this? > > > > http://www.angelfire.com/nv/aldev/pgsql/GreatBridge.html > > > > > -- > Limin Liu > >
Pete Forman <pete.forman@westgeo.com> writes: > I thought that Great Bridge's August benchmarks were rather skewed. > They only used one particular test from the AS3AP suite. AFAIK there was nothing particularly sinister about that --- they didn't have time to run a large number of different tests, so they chose ones that seemed most important. They certainly didn't try a bunch of tests and then publish only the most favorable; the two tests used were selected at the beginning of the project, before anyone knew what the results would look like. regards, tom lane
Don Baccus <dhogaza@pacifier.com> writes: > Great Bridge didn't do the benchmarking, they hired a third party to > do so. And that third party didn't, AFAIK, cherry-pick tests in order > to "prove" PG's superiority. In fairness, the third party was Xperts Inc, who have long done a lot of programming-related work for Landmark Communications; so there's a pretty close working relationship, it's not exactly arms-length. I think what may be more worth noting is that that benchmarking project was started as part of Landmark's "due diligence" investigation while deciding whether they wanted to bet a company on Postgres. They didn't go into it with the notion of proving Postgres superior; they went into it to find out if they were betting on a dog. They were very pleasantly surprised (as was the core group, when we first saw the results!). Naturally, their marketing guys said "hey, let's clean this up and publish it". There's a certain amount of after-the-fact selection here, since you'd certainly never have seen the results if they hadn't been favorable to Postgres; but there was no attempt to skew the results in Postgres' favor. If anything, the opposite. > The MySQL folk have always cherry-picked their benchmarks, long lied > about features in PG, do their benchmarking using default values > for PG's shared buffer etc WITHOUT TELLING PEOPLE while at the same > time installing MySQL with larger-than-default memory usage limits (the > group hired by GB used MySQL's default installation, but EXPLICITLY SAID > SO in the report), etc. The revised results that are on GB's site now include curves for MySQL *with* tuning per advice from the MySQL folk. regards, tom lane
At 10:24 AM 11/13/00 -0800, Limin Liu wrote: >>>> <excerpt>This's great. I have tested Postgres and MySQL with the benchmark shipped with mysql and (of course) MySQL out perform Postgres. </excerpt> <<<<<<<< So how many simultaneous read/write processes does the MySQL benchmark fire up? Why test a benchmark provided by the mysql folk? That's like trying the benchmark provided by Intel for the initial Pentium 4 announcement and ignoring all the benchmarks they didn't provide you because AMD thunderbird+DDR (AMD 760 chipset) kicks P4 butt on many of them. I should hope you're not so naive as to suppose that the MySQL folk would ship a benchmark showing better performance by PG (or Oracle, or Sybase etc)? I also hope that the PG crew, and Great Bridge, never stoop so low as to ship benchmarks wired to "prove" PG's superiority. They MySQL folk have been liars and cheaters for years, there's no reason to put any faith into their benchmark efforts. >>>> - Don Baccus, Portland OR <<dhogaza@pacifier.com> Nature photos, on-line guides, Pacific Northwest Rare Bird Alert Service and other goodies at http://donb.photo.net.