Re: Faster data load - Mailing list pgsql-general

From Lok P
Subject Re: Faster data load
Date
Msg-id CAKna9VYFp4Bqc8-9vyb_AbZH4xpXnVUsM_2papyw10WMpbjiOA@mail.gmail.com
Whole thread Raw
In response to Re: Faster data load  (Muhammad Usman Khan <usman.k@bitnine.net>)
Responses Re: Faster data load
List pgsql-general

On Fri, 6 Sept, 2024, 9:20 am Muhammad Usman Khan, <usman.k@bitnine.net> wrote:
Hi,

You can use pg_partman. If your table is partitioned, you can manage partitions in parallel by distributing the load across partitions concurrently. Or you can use citus. It can be an excellent solution, especially for handling large data volumes and parallelizing data operations


Thank you. 
The tables are partitioned. Also during index creation we are trying to do it multiple partitions at same time from multiple sessions.But seeing out of memory error in 5th or 6th session. And even each sessions taking 30mins per partitions for index creation. Attach index partitions happening in seconds though. 

pgsql-general by date:

Previous
From: Muhammad Usman Khan
Date:
Subject: Re: Faster data load
Next
From: Ron Johnson
Date:
Subject: Re: Faster data load