Re: Is there a meaningful benchmark? - Mailing list pgsql-general

From Tom Lane
Subject Re: Is there a meaningful benchmark?
Date
Msg-id 14357.1237565189@sss.pgh.pa.us
Whole thread Raw
In response to Re: Is there a meaningful benchmark?  ("Will Rutherdale (rutherw)" <rutherw@cisco.com>)
Responses Re: Is there a meaningful benchmark?  ("Will Rutherdale (rutherw)" <rutherw@cisco.com>)
List pgsql-general
"Will Rutherdale (rutherw)" <rutherw@cisco.com> writes:
> However, keeping the KISS principle in mind, you can create a benchmark
> that simply sets up a sample database and forks off a bunch of processes
> to do random updates for an hour, say.  Dead simple.

Indeed, and more than likely dead useless.  The only benchmark that
really counts is one's live application, which is probably not
update-only and probably has a fairly non-random update pattern too.

What people have been trying to point out to you is that you can
certainly measure *something* with a benchmark test that has no thought
behind it, but it's not clear whether the numbers you come up with will
have any real-world value.

            regards, tom lane

pgsql-general by date:

Previous
From: Scott Marlowe
Date:
Subject: Re: Is there a meaningful benchmark?
Next
From: Greg Smith
Date:
Subject: Re: Is there a meaningful benchmark?