Re: Question on pgbench output

From: Tom Lane
Subject: Re: Question on pgbench output
Date: ,
Msg-id: 24809.1238799146@sss.pgh.pa.us
(view: Whole thread, Raw)
In response to: Re: Question on pgbench output  (Greg Smith)
Responses: Re: Question on pgbench output  (David Kerr)
Re: Question on pgbench output  (Greg Smith)
List: pgsql-performance

Tree view

Question on pgbench output  (David Kerr, )
 Re: Question on pgbench output  (Tom Lane, )
  Re: Question on pgbench output  (David Kerr, )
   Re: Question on pgbench output  (Tom Lane, )
 Re: Question on pgbench output  (Scott Marlowe, )
 Re: Question on pgbench output  (Greg Smith, )
  Re: Question on pgbench output  (Tom Lane, )
   Re: Question on pgbench output  (David Kerr, )
    Re: Question on pgbench output  (David Kerr, )
    Re: Question on pgbench output  (Simon Riggs, )
     Re: Question on pgbench output  (Tom Lane, )
      Re: Question on pgbench output  (David Kerr, )
       Re: Question on pgbench output  (Tom Lane, )
   Re: Question on pgbench output  (Greg Smith, )
    Re: Question on pgbench output  (David Kerr, )

Greg Smith <> writes:
> pgbench is extremely bad at simulating large numbers of clients.  The
> pgbench client operates as a single thread that handles both parsing the
> input files, sending things to clients, and processing their responses.
> It's very easy to end up in a situation where that bottlenecks at the
> pgbench client long before getting to 400 concurrent connections.

Yeah, good point.

> That said, if you're in the hundreds of transactions per second range that
> probably isn't biting you yet.  I've seen it more once you get around
> 5000+ things per second going on.

However, I don't think anyone else has been pgbench'ing transactions
where client-side libpq has to absorb (and then discard) a megabyte of
data per xact.  I wouldn't be surprised that that eats enough CPU to
make it an issue.  David, did you pay any attention to how busy the
pgbench process was?

Another thing that strikes me as a bit questionable is that your stated
requirements involve being able to pump 400MB/sec from the database
server to your various client machines (presumably those 400 people
aren't running their client apps directly on the DB server).  What's the
network fabric going to be, again?  Gigabit Ethernet won't cut it...

            regards, tom lane


pgsql-performance by date:

From: Greg Smith
Date:
Subject: Re: Question on pgbench output
From: Scott Carey
Date:
Subject: Re: Raid 10 chunksize