Thread: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
From
"Burgess, Freddie"
Date:
Simple steps:
BACKUP: pg_dump -U postgres -d <database> > sherlock.dmp <- From the pg10 instance
RESTORE: psql -U postgres -d <database> -1 -f sherlock.dmp <- On the pg12 instance
Postgres Log:
free(): invalid pointer
free(): invalid pointer
2020-11-05 14:07:33.784 EST [26] LOG: background worker "parallel worker" (PID 150) was terminated by signal 6: Aborted
2020-11-05 14:07:33.784 EST [26] LOG: terminating any other active server processes
2020-11-05 14:07:33.784 EST [32] WARNING: terminating connection because of crash of another server process
2020-11-05 14:07:33.784 EST [32] DETAIL: The postmaster has commanded this server process to roll back the current transaction and exit, because another server process exited abnormally and possibly corrupted shared memory.
2020-11-05 14:07:33.784 EST [32] HINT: In a moment you should be able to reconnect to the database and repeat your command.
2020-11-05 14:07:33.784 EST [61] WARNING: terminating connection because of crash of another server process
2020-11-05 14:07:33.784 EST [61] DETAIL: The postmaster has commanded this server process to roll back the current transaction and exit, because another server process exited abnormally and possibly corrupted shared memory.
2020-11-05 14:07:33.784 EST [61] HINT: In a moment you should be able to reconnect to the database and repeat your command.
2020-11-05 14:07:34.699 EST [26] LOG: all server processes terminated; reinitializing
2020-11-05 14:07:42.266 EST [154] LOG: database system was interrupted; last known up at 2020-11-05 14:06:02 EST
2020-11-05 14:08:05.855 EST [154] LOG: database system was not properly shut down; automatic recovery in progress
2020-11-05 14:08:05.859 EST [154] LOG: redo starts at 7E/93B22C8
2020-11-05 14:08:15.931 EST [154] LOG: invalid record length at 7F/74ECBE30: wanted 24, got 0
2020-11-05 14:08:15.931 EST [154] LOG: redo done at 7F/74ECBDF8
2020-11-05 14:08:41.673 EST [26] LOG: database system is ready to accept connections
PostgreSQL is installed on a docker container, running on a EC2 instance with 256 GB of memory
This electronic communication and any attachments may contain confidential and proprietary information of Maxar, Inc. If you are not the intended recipient, or an agent or employee responsible for delivering this communication to the intended recipient, or if you have received this communication in error, please do not print, copy, retransmit, disseminate or otherwise use the information. Please indicate to the sender that you have received this communication in error, and delete the copy you received.
Maxar reserves the right to monitor any electronic communication sent or received by its employees, agents or representatives.
On Thu, 5 Nov 2020 21:19:17 +0000 "Burgess, Freddie" <Freddie.Burgess@maxar.com> wrote: > Simple steps: > > BACKUP: pg_dump -U postgres -d <database> > sherlock.dmp <- From the > pg10 instance RESTORE: psql -U postgres -d <database> -1 -f > sherlock.dmp <- On the pg12 instance > > Postgres Log: > > free(): invalid pointer > free(): invalid pointer > 2020-11-05 14:07:33.784 EST [26] LOG: background worker "parallel > worker" (PID 150) was terminated by signal 6: Aborted 2020-11-05 > 14:07:33.784 EST [26] LOG: terminating any other active server > processes 2020-11-05 14:07:33.784 EST [32] WARNING: terminating > connection because of crash of another server process 2020-11-05 > 14:07:33.784 EST [32] DETAIL: The postmaster has commanded this > server process to roll back the current transaction and exit, because > another server process exited abnormally and possibly corrupted > shared memory. 2020-11-05 14:07:33.784 EST [32] HINT: In a moment > you should be able to reconnect to the database and repeat your > command. 2020-11-05 14:07:33.784 EST [61] WARNING: terminating > connection because of crash of another server process 2020-11-05 > 14:07:33.784 EST [61] DETAIL: The postmaster has commanded this > server process to roll back the current transaction and exit, because > another server process exited abnormally and possibly corrupted > shared memory. 2020-11-05 14:07:33.784 EST [61] HINT: In a moment > you should be able to reconnect to the database and repeat your > command. 2020-11-05 14:07:34.699 EST [26] LOG: all server processes > terminated; reinitializing 2020-11-05 14:07:42.266 EST [154] LOG: > database system was interrupted; last known up at 2020-11-05 14:06:02 > EST 2020-11-05 14:08:05.855 EST [154] LOG: database system was not > properly shut down; automatic recovery in progress 2020-11-05 > 14:08:05.859 EST [154] LOG: redo starts at 7E/93B22C8 2020-11-05 > 14:08:15.931 EST [154] LOG: invalid record length at 7F/74ECBE30: > wanted 24, got 0 2020-11-05 14:08:15.931 EST [154] LOG: redo done at > 7F/74ECBDF8 2020-11-05 14:08:41.673 EST [26] LOG: database system is > ready to accept connections > > PostgreSQL is installed on a docker container, running on a EC2 > instance with 256 GB of memory > It'd be interesting to know what is doing the crashing parallel worker. Considering it's a background worker, the easiest way is probably enabling core dumps and inspecting them with gdb. Make sure you have debug symbols installed and send us the backtrace. Some basic instructions are in: https://wiki.postgresql.org/wiki/Getting_a_stack_trace_of_a_running_PostgreSQL_backend_on_Linux/BSD#Getting_a_trace_from_a_randomly_crashing_backend The error message is most likely a random glibc free() error, not sure where it's coming from or whether it has something to do with docker. Maybe try preparing a reproducer, i.e. a small database triggering the issue, which we might use to reproduce the issue on our machines. regards -- Tomas Vondra EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company
On Sat, Nov 7, 2020 at 1:10 PM Tomas Vondra <tomas.vondra@enterprisedb.com> wrote: > On Thu, 5 Nov 2020 21:19:17 +0000 > "Burgess, Freddie" <Freddie.Burgess@maxar.com> wrote: > > BACKUP: pg_dump -U postgres -d <database> > sherlock.dmp <- From the > > pg10 instance RESTORE: psql -U postgres -d <database> -1 -f > > sherlock.dmp <- On the pg12 instance > > > > Postgres Log: > > > > free(): invalid pointer > > free(): invalid pointer > > 2020-11-05 14:07:33.784 EST [26] LOG: background worker "parallel > > worker" (PID 150) was terminated by signal 6: Aborted 2020-11-05 > It'd be interesting to know what is doing the crashing parallel worker. > Considering it's a background worker, the easiest way is probably > enabling core dumps and inspecting them with gdb. Make sure you have > debug symbols installed and send us the backtrace. I guess that would have to be a parallel index build. The OP could try setting max_parallel_mainentance_workers = 0 to see if that's a useful workaround, until we can track the problem (double free?) down and fix it, or maybe that would reveal that the same crash can also happen in a regular backend.
Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
From
"Burgess, Freddie"
Date:
We got further in the process, thanks to your feedback. The PostgreSQL 12 database heavily uses HSTORE syntax.
Freddie
SET
SET
SET
SET
SET
set_config
------------
(1 row)
SET
SET
SET
SET
CREATE SCHEMA
ALTER SCHEMA
CREATE SCHEMA
ALTER SCHEMA
CREATE SCHEMA
ALTER SCHEMA
CREATE SCHEMA
ALTER SCHEMA
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
SET
CREATE TABLE
ALTER TABLE
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE AGGREGATE
ALTER AGGREGATE
CREATE SERVER
ALTER SERVER
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE FOREIGN TABLE
ALTER FOREIGN TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
COPY 0
COPY 405340865
COPY 1141361
COPY 225470
COPY 1
COPY 19
COPY 112
COPY 12
COPY 60
COPY 0
COPY 4
COPY 23
COPY 33
COPY 293
COPY 494789614
COPY 62819765
COPY 0
COPY 871396
COPY 76
COPY 56
COPY 112
COPY 1
COPY 1
COPY 17
COPY 115
COPY 11
COPY 71
COPY 71
COPY 36
setval
--------
19
(1 row)
setval
--------
112
(1 row)
setval
--------
12
(1 row)
setval
--------
60
(1 row)
setval
--------
1
(1 row)
setval
--------
4
(1 row)
setval
--------
23
(1 row)
setval
--------
33
(1 row)
setval
--------
1
(1 row)
setval
---------
1533006
(1 row)
setval
--------
99
(1 row)
setval
--------
66
(1 row)
setval
--------
132
(1 row)
setval
--------
17
(1 row)
setval
--------
33
(1 row)
setval
--------
99
(1 row)
setval
--------
66
(1 row)
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
psql:africa_pg10_data.sql:965201756: ERROR: operator does not exist: public.hstore ?& text[]
LINE 6: select p_tags IS NOT null AND p_tags ?& p_keys;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns the has all test on tags.
-- It does NOT return NULL tag rows.
select p_tags IS NOT null AND p_tags ?& p_keys;
CONTEXT: SQL function "shhst_hasallkeys" during inlining
CREATE INDEX
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
psql:africa_pg10_data.sql:965201884: ERROR: role "1122376" does not exist
GRANT
psql:africa_pg10_data.sql:965201892: ERROR: role "1122376" does not exist
GRANT
psql:africa_pg10_data.sql:965201900: ERROR: operator does not exist: public.hstore ?& text[]
LINE 6: select p_tags IS NOT null AND p_tags ?& p_keys;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns the has all test on tags.
-- It does NOT return NULL tag rows.
select p_tags IS NOT null AND p_tags ?& p_keys;
CONTEXT: SQL function "shhst_hasallkeys" during inlining
psql:africa_pg10_data.sql:965201907: ERROR: materialized view "building_polygons" has not been populated
HINT: Use the REFRESH MATERIALIZED VIEW command.
psql:africa_pg10_data.sql:965201914: ERROR: operator does not exist: public.hstore @> public.hstore
LINE 6: SELECT p_tags@>p_tagList;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the taglist is in the tags.
-- It does NOT return NULL tag rows.
SELECT p_tags@>p_tagList;
CONTEXT: SQL function "shhst_hasalltags" during inlining
psql:africa_pg10_data.sql:965201921: ERROR: materialized view "drivable_roadways" has not been populated
HINT: Use the REFRESH MATERIALIZED VIEW command.
psql:africa_pg10_data.sql:965201928: ERROR: operator does not exist: public.hstore @> public.hstore
LINE 6: SELECT p_tags@>p_tagList;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the taglist is in the tags.
-- It does NOT return NULL tag rows.
SELECT p_tags@>p_tagList;
CONTEXT: SQL function "shhst_hasalltags" during inlining
psql:africa_pg10_data.sql:965201935: ERROR: operator does not exist: public.hstore ? text
LINE 6: SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the input tags contain the input key with one of the input values.
-- It does not return NULL tag rows.
SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
CONTEXT: SQL function "shhst_keyinvalues" during inlining
psql:africa_pg10_data.sql:965201942: ERROR: operator does not exist: public.hstore ? text
LINE 6: SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the input tags contain the input key with one of the input values.
-- It does not return NULL tag rows.
SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
CONTEXT: SQL function "shhst_keyinvalues" during inlining
psql:africa_pg10_data.sql:965201949: ERROR: relation "data_properties" does not exist
LINE 2: FROM data_properties dp, data_defaults dd
^
QUERY: SELECT COALESCE(dp.optionals->>key::TEXT, dd.optionals->>key::TEXT)
FROM data_properties dp, data_defaults dd
CONTEXT: PL/pgSQL function sherlock.sheng_getdataproperty(character varying) line 19 at SQL statement
From: Thomas Munro <thomas.munro@gmail.com>
Sent: Friday, November 6, 2020 8:11 PM
To: Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: Burgess, Freddie <Freddie.Burgess@maxar.com>; pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
Sent: Friday, November 6, 2020 8:11 PM
To: Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: Burgess, Freddie <Freddie.Burgess@maxar.com>; pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.
On Sat, Nov 7, 2020 at 1:10 PM Tomas Vondra
<tomas.vondra@enterprisedb.com> wrote:
> On Thu, 5 Nov 2020 21:19:17 +0000
> "Burgess, Freddie" <Freddie.Burgess@maxar.com> wrote:
> > BACKUP: pg_dump -U postgres -d <database> > sherlock.dmp <- From the
> > pg10 instance RESTORE: psql -U postgres -d <database> -1 -f
> > sherlock.dmp <- On the pg12 instance
> >
> > Postgres Log:
> >
> > free(): invalid pointer
> > free(): invalid pointer
> > 2020-11-05 14:07:33.784 EST [26] LOG: background worker "parallel
> > worker" (PID 150) was terminated by signal 6: Aborted 2020-11-05
> It'd be interesting to know what is doing the crashing parallel worker.
> Considering it's a background worker, the easiest way is probably
> enabling core dumps and inspecting them with gdb. Make sure you have
> debug symbols installed and send us the backtrace.
I guess that would have to be a parallel index build. The OP could
try setting max_parallel_mainentance_workers = 0 to see if that's a
useful workaround, until we can track the problem (double free?) down
and fix it, or maybe that would reveal that the same crash can also
happen in a regular backend.
On Sat, Nov 7, 2020 at 1:10 PM Tomas Vondra
<tomas.vondra@enterprisedb.com> wrote:
> On Thu, 5 Nov 2020 21:19:17 +0000
> "Burgess, Freddie" <Freddie.Burgess@maxar.com> wrote:
> > BACKUP: pg_dump -U postgres -d <database> > sherlock.dmp <- From the
> > pg10 instance RESTORE: psql -U postgres -d <database> -1 -f
> > sherlock.dmp <- On the pg12 instance
> >
> > Postgres Log:
> >
> > free(): invalid pointer
> > free(): invalid pointer
> > 2020-11-05 14:07:33.784 EST [26] LOG: background worker "parallel
> > worker" (PID 150) was terminated by signal 6: Aborted 2020-11-05
> It'd be interesting to know what is doing the crashing parallel worker.
> Considering it's a background worker, the easiest way is probably
> enabling core dumps and inspecting them with gdb. Make sure you have
> debug symbols installed and send us the backtrace.
I guess that would have to be a parallel index build. The OP could
try setting max_parallel_mainentance_workers = 0 to see if that's a
useful workaround, until we can track the problem (double free?) down
and fix it, or maybe that would reveal that the same crash can also
happen in a regular backend.
Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
From
"Burgess, Freddie"
Date:
This is the function that is
--
$$;
-- Name: shhst_hasallkeys(public.hstore, text[]); Type: FUNCTION; Schema: sherlock; Owner: sherlock
--
CREATE FUNCTION sherlock.shhst_hasallkeys(p_tags public.hstore, p_keys text[]) RETURNS boolean
LANGUAGE sql IMMUTABLE
AS $$
-- This file is part of Sherlock.
-- This SQL function returns the has all test on tags.
-- It does NOT return NULL tag rows.
select p_tags IS NOT null AND p_tags ?& p_keys;
ALTER FUNCTION sherlock.shhst_hasallkeys(p_tags public.hstore, p_keys text[]) OWNER TO sherlock;
CREATE INDEX idx_ways_highway ON data.ways USING gist (tags) WHERE sherlock.shhst_hasallkeys(tags, '{highway}'::text[]);
--
-- Name: idx_ways_highway; Type: INDEX; Schema: data; Owner: postgres
--
From: Burgess, Freddie <Freddie.Burgess@maxar.com>
Sent: Monday, November 9, 2020 5:30 PM
To: Thomas Munro <thomas.munro@gmail.com>; Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
Sent: Monday, November 9, 2020 5:30 PM
To: Thomas Munro <thomas.munro@gmail.com>; Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
We got further in the process, thanks to your feedback. The PostgreSQL 12 database heavily uses HSTORE syntax.
Freddie
SET
SET
SET
SET
SET
set_config
------------
(1 row)
SET
SET
SET
SET
CREATE SCHEMA
ALTER SCHEMA
CREATE SCHEMA
ALTER SCHEMA
CREATE SCHEMA
ALTER SCHEMA
CREATE SCHEMA
ALTER SCHEMA
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
SET
CREATE TABLE
ALTER TABLE
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE AGGREGATE
ALTER AGGREGATE
CREATE SERVER
ALTER SERVER
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE FOREIGN TABLE
ALTER FOREIGN TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
COPY 0
COPY 405340865
COPY 1141361
COPY 225470
COPY 1
COPY 19
COPY 112
COPY 12
COPY 60
COPY 0
COPY 4
COPY 23
COPY 33
COPY 293
COPY 494789614
COPY 62819765
COPY 0
COPY 871396
COPY 76
COPY 56
COPY 112
COPY 1
COPY 1
COPY 17
COPY 115
COPY 11
COPY 71
COPY 71
COPY 36
setval
--------
19
(1 row)
setval
--------
112
(1 row)
setval
--------
12
(1 row)
setval
--------
60
(1 row)
setval
--------
1
(1 row)
setval
--------
4
(1 row)
setval
--------
23
(1 row)
setval
--------
33
(1 row)
setval
--------
1
(1 row)
setval
---------
1533006
(1 row)
setval
--------
99
(1 row)
setval
--------
66
(1 row)
setval
--------
132
(1 row)
setval
--------
17
(1 row)
setval
--------
33
(1 row)
setval
--------
99
(1 row)
setval
--------
66
(1 row)
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
psql:africa_pg10_data.sql:965201756: ERROR: operator does not exist: public.hstore ?& text[]
LINE 6: select p_tags IS NOT null AND p_tags ?& p_keys;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns the has all test on tags.
-- It does NOT return NULL tag rows.
select p_tags IS NOT null AND p_tags ?& p_keys;
CONTEXT: SQL function "shhst_hasallkeys" during inlining
CREATE INDEX
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
psql:africa_pg10_data.sql:965201884: ERROR: role "1122376" does not exist
GRANT
psql:africa_pg10_data.sql:965201892: ERROR: role "1122376" does not exist
GRANT
psql:africa_pg10_data.sql:965201900: ERROR: operator does not exist: public.hstore ?& text[]
LINE 6: select p_tags IS NOT null AND p_tags ?& p_keys;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns the has all test on tags.
-- It does NOT return NULL tag rows.
select p_tags IS NOT null AND p_tags ?& p_keys;
CONTEXT: SQL function "shhst_hasallkeys" during inlining
psql:africa_pg10_data.sql:965201907: ERROR: materialized view "building_polygons" has not been populated
HINT: Use the REFRESH MATERIALIZED VIEW command.
psql:africa_pg10_data.sql:965201914: ERROR: operator does not exist: public.hstore @> public.hstore
LINE 6: SELECT p_tags@>p_tagList;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the taglist is in the tags.
-- It does NOT return NULL tag rows.
SELECT p_tags@>p_tagList;
CONTEXT: SQL function "shhst_hasalltags" during inlining
psql:africa_pg10_data.sql:965201921: ERROR: materialized view "drivable_roadways" has not been populated
HINT: Use the REFRESH MATERIALIZED VIEW command.
psql:africa_pg10_data.sql:965201928: ERROR: operator does not exist: public.hstore @> public.hstore
LINE 6: SELECT p_tags@>p_tagList;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the taglist is in the tags.
-- It does NOT return NULL tag rows.
SELECT p_tags@>p_tagList;
CONTEXT: SQL function "shhst_hasalltags" during inlining
psql:africa_pg10_data.sql:965201935: ERROR: operator does not exist: public.hstore ? text
LINE 6: SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the input tags contain the input key with one of the input values.
-- It does not return NULL tag rows.
SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
CONTEXT: SQL function "shhst_keyinvalues" during inlining
psql:africa_pg10_data.sql:965201942: ERROR: operator does not exist: public.hstore ? text
LINE 6: SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the input tags contain the input key with one of the input values.
-- It does not return NULL tag rows.
SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
CONTEXT: SQL function "shhst_keyinvalues" during inlining
psql:africa_pg10_data.sql:965201949: ERROR: relation "data_properties" does not exist
LINE 2: FROM data_properties dp, data_defaults dd
^
QUERY: SELECT COALESCE(dp.optionals->>key::TEXT, dd.optionals->>key::TEXT)
FROM data_properties dp, data_defaults dd
CONTEXT: PL/pgSQL function sherlock.sheng_getdataproperty(character varying) line 19 at SQL statement
From: Thomas Munro <thomas.munro@gmail.com>
Sent: Friday, November 6, 2020 8:11 PM
To: Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: Burgess, Freddie <Freddie.Burgess@maxar.com>; pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
Sent: Friday, November 6, 2020 8:11 PM
To: Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: Burgess, Freddie <Freddie.Burgess@maxar.com>; pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.
On Sat, Nov 7, 2020 at 1:10 PM Tomas Vondra
<tomas.vondra@enterprisedb.com> wrote:
> On Thu, 5 Nov 2020 21:19:17 +0000
> "Burgess, Freddie" <Freddie.Burgess@maxar.com> wrote:
> > BACKUP: pg_dump -U postgres -d <database> > sherlock.dmp <- From the
> > pg10 instance RESTORE: psql -U postgres -d <database> -1 -f
> > sherlock.dmp <- On the pg12 instance
> >
> > Postgres Log:
> >
> > free(): invalid pointer
> > free(): invalid pointer
> > 2020-11-05 14:07:33.784 EST [26] LOG: background worker "parallel
> > worker" (PID 150) was terminated by signal 6: Aborted 2020-11-05
> It'd be interesting to know what is doing the crashing parallel worker.
> Considering it's a background worker, the easiest way is probably
> enabling core dumps and inspecting them with gdb. Make sure you have
> debug symbols installed and send us the backtrace.
I guess that would have to be a parallel index build. The OP could
try setting max_parallel_mainentance_workers = 0 to see if that's a
useful workaround, until we can track the problem (double free?) down
and fix it, or maybe that would reveal that the same crash can also
happen in a regular backend.
On Sat, Nov 7, 2020 at 1:10 PM Tomas Vondra
<tomas.vondra@enterprisedb.com> wrote:
> On Thu, 5 Nov 2020 21:19:17 +0000
> "Burgess, Freddie" <Freddie.Burgess@maxar.com> wrote:
> > BACKUP: pg_dump -U postgres -d <database> > sherlock.dmp <- From the
> > pg10 instance RESTORE: psql -U postgres -d <database> -1 -f
> > sherlock.dmp <- On the pg12 instance
> >
> > Postgres Log:
> >
> > free(): invalid pointer
> > free(): invalid pointer
> > 2020-11-05 14:07:33.784 EST [26] LOG: background worker "parallel
> > worker" (PID 150) was terminated by signal 6: Aborted 2020-11-05
> It'd be interesting to know what is doing the crashing parallel worker.
> Considering it's a background worker, the easiest way is probably
> enabling core dumps and inspecting them with gdb. Make sure you have
> debug symbols installed and send us the backtrace.
I guess that would have to be a parallel index build. The OP could
try setting max_parallel_mainentance_workers = 0 to see if that's a
useful workaround, until we can track the problem (double free?) down
and fix it, or maybe that would reveal that the same crash can also
happen in a regular backend.
Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
From
"Burgess, Freddie"
Date:
This is the configuration on a PG12 instance that was initialized from scratch and not restored from pg10.
sherlock=# SELECT *
sherlock-# FROM pg_extension
sherlock-# ;
oid | extname | extowner | extnamespace | extrelocatable | extversion | extconfig | extcondition
--------+--------------------+----------+--------------+----------------+------------+-----------+-----------------------------------
13433 | plpgsql | 10 | 11 | f | 1.0 | |
16386 | fuzzystrmatch | 10 | 2200 | t | 1.1 | |
16397 | hstore | 10 | 2200 | t | 1.6 | |
From: Burgess, Freddie <Freddie.Burgess@maxar.com>
Sent: Monday, November 9, 2020 6:05 PM
To: Thomas Munro <thomas.munro@gmail.com>; Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
Sent: Monday, November 9, 2020 6:05 PM
To: Thomas Munro <thomas.munro@gmail.com>; Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
This is the function that is
--
$$;
-- Name: shhst_hasallkeys(public.hstore, text[]); Type: FUNCTION; Schema: sherlock; Owner: sherlock
--
CREATE FUNCTION sherlock.shhst_hasallkeys(p_tags public.hstore, p_keys text[]) RETURNS boolean
LANGUAGE sql IMMUTABLE
AS $$
-- This file is part of Sherlock.
-- This SQL function returns the has all test on tags.
-- It does NOT return NULL tag rows.
select p_tags IS NOT null AND p_tags ?& p_keys;
ALTER FUNCTION sherlock.shhst_hasallkeys(p_tags public.hstore, p_keys text[]) OWNER TO sherlock;
CREATE INDEX idx_ways_highway ON data.ways USING gist (tags) WHERE sherlock.shhst_hasallkeys(tags, '{highway}'::text[]);
--
-- Name: idx_ways_highway; Type: INDEX; Schema: data; Owner: postgres
--
From: Burgess, Freddie <Freddie.Burgess@maxar.com>
Sent: Monday, November 9, 2020 5:30 PM
To: Thomas Munro <thomas.munro@gmail.com>; Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
Sent: Monday, November 9, 2020 5:30 PM
To: Thomas Munro <thomas.munro@gmail.com>; Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
We got further in the process, thanks to your feedback. The PostgreSQL 12 database heavily uses HSTORE syntax.
Freddie
SET
SET
SET
SET
SET
set_config
------------
(1 row)
SET
SET
SET
SET
CREATE SCHEMA
ALTER SCHEMA
CREATE SCHEMA
ALTER SCHEMA
CREATE SCHEMA
ALTER SCHEMA
CREATE SCHEMA
ALTER SCHEMA
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE EXTENSION
COMMENT
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE TYPE
ALTER TYPE
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
SET
CREATE TABLE
ALTER TABLE
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE FUNCTION
ALTER FUNCTION
CREATE AGGREGATE
ALTER AGGREGATE
CREATE SERVER
ALTER SERVER
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE MATERIALIZED VIEW
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE VIEW
ALTER TABLE
CREATE FOREIGN TABLE
ALTER FOREIGN TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
CREATE TABLE
ALTER TABLE
CREATE TABLE
ALTER TABLE
CREATE SEQUENCE
ALTER TABLE
ALTER SEQUENCE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
COPY 0
COPY 405340865
COPY 1141361
COPY 225470
COPY 1
COPY 19
COPY 112
COPY 12
COPY 60
COPY 0
COPY 4
COPY 23
COPY 33
COPY 293
COPY 494789614
COPY 62819765
COPY 0
COPY 871396
COPY 76
COPY 56
COPY 112
COPY 1
COPY 1
COPY 17
COPY 115
COPY 11
COPY 71
COPY 71
COPY 36
setval
--------
19
(1 row)
setval
--------
112
(1 row)
setval
--------
12
(1 row)
setval
--------
60
(1 row)
setval
--------
1
(1 row)
setval
--------
4
(1 row)
setval
--------
23
(1 row)
setval
--------
33
(1 row)
setval
--------
1
(1 row)
setval
---------
1533006
(1 row)
setval
--------
99
(1 row)
setval
--------
66
(1 row)
setval
--------
132
(1 row)
setval
--------
17
(1 row)
setval
--------
33
(1 row)
setval
--------
99
(1 row)
setval
--------
66
(1 row)
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
psql:africa_pg10_data.sql:965201756: ERROR: operator does not exist: public.hstore ?& text[]
LINE 6: select p_tags IS NOT null AND p_tags ?& p_keys;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns the has all test on tags.
-- It does NOT return NULL tag rows.
select p_tags IS NOT null AND p_tags ?& p_keys;
CONTEXT: SQL function "shhst_hasallkeys" during inlining
CREATE INDEX
ALTER TABLE
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
CREATE INDEX
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
ALTER TABLE
psql:africa_pg10_data.sql:965201884: ERROR: role "1122376" does not exist
GRANT
psql:africa_pg10_data.sql:965201892: ERROR: role "1122376" does not exist
GRANT
psql:africa_pg10_data.sql:965201900: ERROR: operator does not exist: public.hstore ?& text[]
LINE 6: select p_tags IS NOT null AND p_tags ?& p_keys;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns the has all test on tags.
-- It does NOT return NULL tag rows.
select p_tags IS NOT null AND p_tags ?& p_keys;
CONTEXT: SQL function "shhst_hasallkeys" during inlining
psql:africa_pg10_data.sql:965201907: ERROR: materialized view "building_polygons" has not been populated
HINT: Use the REFRESH MATERIALIZED VIEW command.
psql:africa_pg10_data.sql:965201914: ERROR: operator does not exist: public.hstore @> public.hstore
LINE 6: SELECT p_tags@>p_tagList;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the taglist is in the tags.
-- It does NOT return NULL tag rows.
SELECT p_tags@>p_tagList;
CONTEXT: SQL function "shhst_hasalltags" during inlining
psql:africa_pg10_data.sql:965201921: ERROR: materialized view "drivable_roadways" has not been populated
HINT: Use the REFRESH MATERIALIZED VIEW command.
psql:africa_pg10_data.sql:965201928: ERROR: operator does not exist: public.hstore @> public.hstore
LINE 6: SELECT p_tags@>p_tagList;
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the taglist is in the tags.
-- It does NOT return NULL tag rows.
SELECT p_tags@>p_tagList;
CONTEXT: SQL function "shhst_hasalltags" during inlining
psql:africa_pg10_data.sql:965201935: ERROR: operator does not exist: public.hstore ? text
LINE 6: SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the input tags contain the input key with one of the input values.
-- It does not return NULL tag rows.
SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
CONTEXT: SQL function "shhst_keyinvalues" during inlining
psql:africa_pg10_data.sql:965201942: ERROR: operator does not exist: public.hstore ? text
LINE 6: SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
^
HINT: No operator matches the given name and argument types. You might need to add explicit type casts.
QUERY:
-- This file is part of Sherlock.
-- This SQL function returns true if the input tags contain the input key with one of the input values.
-- It does not return NULL tag rows.
SELECT p_tags?p_key AND p_tags->p_key = ANY(p_values);
CONTEXT: SQL function "shhst_keyinvalues" during inlining
psql:africa_pg10_data.sql:965201949: ERROR: relation "data_properties" does not exist
LINE 2: FROM data_properties dp, data_defaults dd
^
QUERY: SELECT COALESCE(dp.optionals->>key::TEXT, dd.optionals->>key::TEXT)
FROM data_properties dp, data_defaults dd
CONTEXT: PL/pgSQL function sherlock.sheng_getdataproperty(character varying) line 19 at SQL statement
From: Thomas Munro <thomas.munro@gmail.com>
Sent: Friday, November 6, 2020 8:11 PM
To: Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: Burgess, Freddie <Freddie.Burgess@maxar.com>; pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
Sent: Friday, November 6, 2020 8:11 PM
To: Tomas Vondra <tomas.vondra@enterprisedb.com>
Cc: Burgess, Freddie <Freddie.Burgess@maxar.com>; pgsql-bugs@lists.postgresql.org <pgsql-bugs@lists.postgresql.org>
Subject: Re: pg_dump error attempting to upgrade from PostgreSQL 10 to PostgreSQL 12
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.
On Sat, Nov 7, 2020 at 1:10 PM Tomas Vondra
<tomas.vondra@enterprisedb.com> wrote:
> On Thu, 5 Nov 2020 21:19:17 +0000
> "Burgess, Freddie" <Freddie.Burgess@maxar.com> wrote:
> > BACKUP: pg_dump -U postgres -d <database> > sherlock.dmp <- From the
> > pg10 instance RESTORE: psql -U postgres -d <database> -1 -f
> > sherlock.dmp <- On the pg12 instance
> >
> > Postgres Log:
> >
> > free(): invalid pointer
> > free(): invalid pointer
> > 2020-11-05 14:07:33.784 EST [26] LOG: background worker "parallel
> > worker" (PID 150) was terminated by signal 6: Aborted 2020-11-05
> It'd be interesting to know what is doing the crashing parallel worker.
> Considering it's a background worker, the easiest way is probably
> enabling core dumps and inspecting them with gdb. Make sure you have
> debug symbols installed and send us the backtrace.
I guess that would have to be a parallel index build. The OP could
try setting max_parallel_mainentance_workers = 0 to see if that's a
useful workaround, until we can track the problem (double free?) down
and fix it, or maybe that would reveal that the same crash can also
happen in a regular backend.
On Sat, Nov 7, 2020 at 1:10 PM Tomas Vondra
<tomas.vondra@enterprisedb.com> wrote:
> On Thu, 5 Nov 2020 21:19:17 +0000
> "Burgess, Freddie" <Freddie.Burgess@maxar.com> wrote:
> > BACKUP: pg_dump -U postgres -d <database> > sherlock.dmp <- From the
> > pg10 instance RESTORE: psql -U postgres -d <database> -1 -f
> > sherlock.dmp <- On the pg12 instance
> >
> > Postgres Log:
> >
> > free(): invalid pointer
> > free(): invalid pointer
> > 2020-11-05 14:07:33.784 EST [26] LOG: background worker "parallel
> > worker" (PID 150) was terminated by signal 6: Aborted 2020-11-05
> It'd be interesting to know what is doing the crashing parallel worker.
> Considering it's a background worker, the easiest way is probably
> enabling core dumps and inspecting them with gdb. Make sure you have
> debug symbols installed and send us the backtrace.
I guess that would have to be a parallel index build. The OP could
try setting max_parallel_mainentance_workers = 0 to see if that's a
useful workaround, until we can track the problem (double free?) down
and fix it, or maybe that would reveal that the same crash can also
happen in a regular backend.