Re: logical decoding / rewrite map vs. maxAllocatedDescs - Mailing list pgsql-hackers

From Tomas Vondra
Subject Re: logical decoding / rewrite map vs. maxAllocatedDescs
Date
Msg-id 0328ccdf-17d6-911b-ae35-c6dc4c76708a@2ndquadrant.com
Whole thread Raw
In response to Re: logical decoding / rewrite map vs. maxAllocatedDescs  (Tomas Vondra <tomas.vondra@2ndquadrant.com>)
Responses Re: logical decoding / rewrite map vs. maxAllocatedDescs
Re: logical decoding / rewrite map vs. maxAllocatedDescs
List pgsql-hackers
On 08/10/2018 11:59 PM, Tomas Vondra wrote:
> 
> ...
> 
> I suspect there's some other ingredient, e.g. some manipulation with the
> subscription. Or maybe it's not needed at all and I'm just imagining things.
> 

Indeed, the manipulation with the subscription seems to be the key here.
I pretty reliably get the 'could not read block' error when doing this:

1) start the insert pgbench

   pgbench -n -c 4 -T 300 -p 5433 -f insert.sql test

2) start the vacuum full pgbench

   pgbench -n -f vacuum.sql -T 300 -p 5433 test

3) try to create a subscription, but with small amount of conflicting
data so that the sync fails like this:

  LOG:  logical replication table synchronization worker for
  subscription "s", table "t" has started
  ERROR:  duplicate key value violates unique constraint "t_pkey"
  DETAIL:  Key (a)=(5997542) already exists.
  CONTEXT:  COPY t, line 1
  LOG:  worker process: logical replication worker for subscription
  16458 sync 16397 (PID 31983) exited with exit code 1

4) At this point the insert pgbench (at least some clients) should have
failed with the error. If not, rinse and repeat.

This kinda explains why I've been seeing the error only occasionally,
because it only happened when I forgotten to clean the table on the
subscriber while recreating the subscription.

regards

-- 
Tomas Vondra                  http://www.2ndQuadrant.com
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services


pgsql-hackers by date:

Previous
From: Andrew Dunstan
Date:
Subject: Commitfest 2018-07 is closed
Next
From: David Rowley
Date:
Subject: Re: [sqlsmith] ERROR: partition missing from subplans