Re: PARALLEL CTAS - Mailing list pgsql-sql

From Shane Borden
Subject Re: PARALLEL CTAS
Date
Msg-id C1789BA9-1AAE-4BD7-A9FF-E0FB8AF5B54F@gmail.com
Whole thread Raw
In response to Re: PARALLEL CTAS  (Erik Brandsberg <erik@heimdalldata.com>)
Responses Re: PARALLEL CTAS
List pgsql-sql
The issue is there are certain performance benefits to be had by doing parallel CTAS operations and when converting from Oracle to PostgreSQL switching to a “COPY” operation isn’t feasible.
---

Thanks,


Shane Borden
sborden76@gmail.com

On Dec 12, 2022, at 11:55 AM, Erik Brandsberg <erik@heimdalldata.com> wrote:

Copy operations are by far the most efficient way to do bulk loads.  The fdw extension isn't very efficient based on prior experience.

On Mon, Dec 12, 2022 at 11:17 AM Shane Borden <sborden76@gmail.com> wrote:
Based on testing thus far, it appears that the only way to get a bulk load operation (similar to oracle) would be to use the COPY command or to use multiple connections and break up the inserts across connections.  I did see a possibility of using the postgres_fdw extension and use the batch functionality, but I haven’t tested that yet.

Does anyone know the status of this feature / patch that was discussed in this link?


Is there a way in PostgreSQL to parallelize a CTAS statement similar to how you can do it in Oracle?

---

Thanks,


Shane Borden
sborden76@gmail.com


pgsql-sql by date:

Previous
From: Erik Brandsberg
Date:
Subject: Re: PARALLEL CTAS
Next
From: Rob Sargent
Date:
Subject: Re: PARALLEL CTAS