Re: Adding a pgbench run to buildfarm - Mailing list pgsql-hackers

From Mark Kirkwood
Subject Re: Adding a pgbench run to buildfarm
Date
Msg-id 44C45757.4090105@paradise.net.nz
Whole thread Raw
In response to Re: Adding a pgbench run to buildfarm  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: Adding a pgbench run to buildfarm  (Gavin Sherry <swm@linuxworld.com.au>)
List pgsql-hackers
Tom Lane wrote:
> Mark Kirkwood <markir@paradise.net.nz> writes:
>> Scale factor 10 produces an accounts table of about 130 Mb. Given that 
>> most HW these days has at least 1G of ram, this probably means not much 
>> retrieval IO is tested (only checkpoint and wal fsync). Do we want to 
>> try 100 or even 200? (or recommend scale factor such that size > ram)?
> 
> That gets into a different set of questions, which is what we want the
> buildfarm turnaround time to be like.  The faster members today produce
> a result within 10-15 minutes of pulling their CVS snaps, and I'd be
> seriously unhappy if that changed to an hour or three.  Maybe we need to
> divorce compile/regression tests from performance tests?
> 
>

Right - this leads to further questions like, what the performance 
testing on the buildfarms is actually for. If it is mainly to catch 
regressions introduced by any new code, then scale factor 10 (i.e 
essentially in memory testing) may in fact be the best way to show this up.

Cheers

Mark


pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: Adding a pgbench run to buildfarm
Next
From: Gavin Sherry
Date:
Subject: Re: Adding a pgbench run to buildfarm