Bulk Insert into PostgreSQL - Mailing list pgsql-hackers

From Srinivas Karthik V
Subject Bulk Insert into PostgreSQL
Date
Msg-id CAEfuzeRtZ-k14+ozqrQ+1T1wPG8tfw6xZit1MxH=Oh4Yb_+xYA@mail.gmail.com
Whole thread Raw
Responses Re: Bulk Insert into PostgreSQL
RE: Bulk Insert into PostgreSQL
List pgsql-hackers
Hi,
I am performing a bulk insert of 1TB TPC-DS benchmark data into PostgreSQL 9.4. It's taking around two days to insert 100 GB of data. Please let me know your suggestions to improve the performance. Below are the configuration parameters I am using:
shared_buffers =12GB
maintainence_work_mem = 8GB
work_mem = 1GB
fsync = off
synchronous_commit = off
checkpoint_segments = 256       
checkpoint_timeout = 1h       
checkpoint_completion_target = 0.9   
checkpoint_warning = 0
autovaccum = off
Other parameters are set to default value. Moreover, I have specified the primary key constraint during table creation. This is the only possible index being created before data loading and I am sure there are no other indexes apart from the primary key column(s).

Regards,
Srinivas Karthik


pgsql-hackers by date:

Previous
From: Magnus Hagander
Date:
Subject: Re: commitfest app moving patch error
Next
From: Pavel Stehule
Date:
Subject: Re: [HACKERS] proposal: schema variables