Postgres Pro
Downloads
Home   >   mailing lists

Most effective and fast way to load few Tbyte of data from flat files into postgresql - Mailing list pgsql-general

From Dirk Krautschick
Subject Most effective and fast way to load few Tbyte of data from flat files into postgresql
Date
Msg-id AM0PR05MB6082D02993A44A96B2F6D70EE9560@AM0PR05MB6082.eurprd05.prod.outlook.com
Whole thread Raw
Responses Re: Most effective and fast way to load few Tbyte of data from flat files into postgresql  ("Peter J. Holzer" <hjp-pgsql@hjp.at>)
List pgsql-general
Tree view 
Hi,

what would be the fastest or most effective way to load few (5-10) TB of data from flat files into
a postgresql database, including some 1TB tables and blobs?

There is the copy command but there is no way for native parallelism, right? I have found pg_bulkload
but haven't tested it yet. As far I can see EDB has its EDB*Loader as a commercial option.

Anything else to recommend?

Thanks and best regards

Dirk

pgsql-general by date:

Previous
From: Tim Clarke
Date:
Subject: Re: Migration of DB2 java stored procedures to PostgreSQL
Next
From: David Rowley
Date:
Subject: Re: Query plan prefers hash join when nested loop is much faster