Re: Loading 500m json files to database - Mailing list pgsql-general

From pinker
Subject Re: Loading 500m json files to database
Date
Msg-id 1585009322858-0.post@n3.nabble.com
Whole thread Raw
In response to Re: Loading 500m json files to database  (Ertan Küçükoğlu <ertan.kucukoglu@1nar.com.tr>)
List pgsql-general
Ertan Küçükoğlu wrote
> However, if possible, you may think of using a local physical computer to
> do all uploading and after do backup/restore on cloud system.
>
> Compressed backup will be far less internet traffic compared to direct
> data inserts.

I was thinking about that but data source is a blob storage, so downloading
it first and then loading locally it's couple days extra for processing :/
it's not that fast even when I'm doing it locally ... so that would be like
extra 2 steps overhead :/



--
Sent from: https://www.postgresql-archive.org/PostgreSQL-general-f1843780.html



pgsql-general by date:

Previous
From: pinker
Date:
Subject: Re: Loading 500m json files to database
Next
From: pinker
Date:
Subject: Re: Loading 500m json files to database