Re: poor performance with Context Switch Storm at TPC-W. - Mailing list pgsql-hackers

From Katsuhiko Okano
Subject Re: poor performance with Context Switch Storm at TPC-W.
Date
Msg-id 200607141457.CFC04165.PBLJLPVTILUBOPu@oss.ntt.co.jp
Whole thread Raw
In response to Re: poor performance with Context Switch Storm at TPC-W.  (Alvaro Herrera <alvherre@commandprompt.com>)
Responses CSStorm occurred again by postgreSQL8.2. (Re: poor performance with Context Switch Storm at TPC-W.)  (Katsuhiko Okano <okano.katsuhiko@oss.ntt.co.jp>)
Re: poor performance with Context Switch Storm at TPC-W.  ("Jim C. Nasby" <jnasby@pervasive.com>)
List pgsql-hackers
Hi.


Alvaro Herrera wrote:

> Katsuhiko Okano wrote:
> 
> > I suspected conflict of BufMappingLock.
> > but, collected results are seen,
> > occurrence of CSStorm and the increase of BufMappingLock counts
> > seem not to correspond.
> > Instead, SubtransControlLock and SubTrans were increasing.
> > I do not understand what in the cause of CSStorm.
> 
> Please see this thread:
> http://archives.postgresql.org/pgsql-hackers/2005-11/msg01547.php
> (actually it's a single message AFAICT)
> 
> This was applied on the 8.2dev code, so I'm surprised that 8.2dev
> behaves the same as 8.1.
> 
> Does your problem have any relationship to what's described there?
> 
Probably it is related.
There is no telling are a thing with the bad method of a lock and 
whether it is bad that the number of LRU buffers is simply small.


> I also wondered whether the problem may be that the number of SLRU
> buffers we use for subtrans is too low.  But the number was increased
> from the default 8 to 32 in 8.2dev as well.  Maybe you could try
> increasing that even further; say 128 and see if the problem is still
> there.  (src/include/access/subtrans.h, NUM_SUBTRANS_BUFFERS).
By PostgreSQL8.2, NUM_SUBTRANS_BUFFERS was changed into 128
and recompile and measured again.
NOT occurrence of CSStorm. The value of WIPS was about 400.
(but the value of WIPS fell about to 320 at intervals of 4 to 6 minutes.)

If the number of SLRU buffers is too low,
also in PostgreSQL8.1.4, if the number of buffers is increased
I think that the same result is brought.
(Although the buffer of CLOG or a multi-transaction also increases,
I think that effect is small)  

Now, NUM_SLRU_BUFFERS is changed into 128 in PostgreSQL8.1.4
and is under measurement.


regards,
--------
Katsuhiko Okano
okano katsuhiko _at_ oss ntt co jp


pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: [PATCHES] include compile problems
Next
From: Lukas Smith
Date:
Subject: Re: monolithic distro