Re: Heavily modified big table bloat even in auto vacuum is running - Mailing list pgsql-hackers

From Haribabu kommi
Subject Re: Heavily modified big table bloat even in auto vacuum is running
Date
Msg-id 8977CB36860C5843884E0A18D8747B0372BC8A7E@szxeml558-mbs.china.huawei.com
Whole thread Raw
In response to Re: Heavily modified big table bloat even in auto vacuum is running  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: Heavily modified big table bloat even in auto vacuum is running  (Amit Kapila <amit.kapila16@gmail.com>)
List pgsql-hackers
On 12 October 2013 11:30 Tom Lane wrote:
>Haribabu kommi <haribabu.kommi@huawei.com> writes:
>> To handle the above case instead of directly resetting the dead tuples
>> as zero, how if the exact dead tuples are removed from the table stats. With this approach vacuum gets triggered
frequentlythus it reduces the bloat. 

>This does not seem like a very good idea as-is, because it will mean that n_dead_tuples can diverge arbitrarily far
fromreality over time, as a result of accumulation of errors.  It also doesn't seem  
>like a very good idea that VACUUM sets n_live_tuples while only adjusting n_dead_tuples incrementally; ideally those
countersshould move in the same fashion. 
>In short, I think this patch will create at least as many problems as it fixes.

>What would make more sense to me is for VACUUM to estimate the number of remaining dead tuples somehow and send that
inits message.  However, since the whole point here is that we aren't accounting for  
>transactions that commit while VACUUM runs, it's not very clear how to do that.

>Another way to look at it is that we want to keep any increments to n_dead_tuples that occur after VACUUM takes its
snapshot. Maybe we could have VACUUM copy the n_dead_tuples value as it exists when  
>VACUUM starts, and then send that as the value to subtract when it's done?

Taking of n_dead_tuples copy and pass the same at the vacuum end to subtract from table stats may not be correct, as
vacuummay not be cleaned all the dead tuples because of tuple visibility 
To other transactions. How about resets the n_dead_tuples as zero if it goes negative because of errors?


Regards,
Hari babu.




pgsql-hackers by date:

Previous
From: Tatsuo Ishii
Date:
Subject: Re: Description on bind message
Next
From: Pavan Deolasee
Date:
Subject: Standby catch up state change