Re: [HACKERS] logical replication worker and statistics - Mailing list pgsql-hackers

From Petr Jelinek
Subject Re: [HACKERS] logical replication worker and statistics
Date
Msg-id 394ebe96-b03f-2ffa-530a-47fc60e1af16@2ndquadrant.com
Whole thread Raw
In response to Re: [HACKERS] logical replication worker and statistics  (Peter Eisentraut <peter.eisentraut@2ndquadrant.com>)
Responses Re: [HACKERS] logical replication worker and statistics  (Peter Eisentraut <peter.eisentraut@2ndquadrant.com>)
List pgsql-hackers
On 12/04/17 05:41, Peter Eisentraut wrote:
> On 4/10/17 13:06, Stas Kelvich wrote:
>>
>>> On 10 Apr 2017, at 19:50, Peter Eisentraut <peter.eisentraut@2ndquadrant.com> wrote:
>>>
>>> On 4/10/17 05:49, Stas Kelvich wrote:
>>>> Here is small patch to call statistics in logical worker. Originally i thought that stat
>>>> collection during logical replication should manually account amounts of changed tuples,
>>>> but seems that it is already smoothly handled on relation level. So call to 
>>>> pgstat_report_stat() is enough.
>>>
>>> I wonder whether we need a similar call somewhere in tablesync.c.  It
>>> seems to work without it, though.
>>
>> I thought it spins up the same worker from worker.c.
> 
> It depends on which of the various tablesync scenarios happens.  If the
> apply lags behind the tablesync, then the apply doesn't process commit
> messages until it has caught up.  So the part of the code you patched
> wouldn't be called.
> 

Indeed, if catchup phase didn't happen (because tablesync was faster
than apply) then the commit handler is never called so all the changes
made by copy would be forgotten. Also the tablesync worker might exit
from process_syncing_tables() call which is called before we report
stats in the commit handler so again some changes might be forgotten.

I attached modified version of the patch that also reports stats in
finish_sync_worker() when there is outstanding transaction. The test can
stay the same.

-- 
  Petr Jelinek                  http://www.2ndQuadrant.com/
  PostgreSQL Development, 24x7 Support, Training & Services

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers

Attachment

pgsql-hackers by date:

Previous
From: Jaime Casanova
Date:
Subject: Re: [HACKERS] Patch: Write Amplification Reduction Method (WARM)
Next
From: "Daniel Verite"
Date:
Subject: Re: [HACKERS] Variable substitution in psql backtick expansion