RE: Loading 500m json files to database - Mailing list pgsql-general

From Kevin Brannen
Subject RE: Loading 500m json files to database
Date
Msg-id SA0PR19MB4255C6E91FA6414FFCF61CAAA4F10@SA0PR19MB4255.namprd19.prod.outlook.com
Whole thread Raw
In response to Re: Loading 500m json files to database  (Rob Sargent <robjsargent@gmail.com>)
Responses Re: Loading 500m json files to database
List pgsql-general
From: Rob Sargent <robjsargent@gmail.com>

> Sorry if I missed it, but have we seen the size range of these json files?

Not that I've seen, but that's an implementation detail for whoever is doing the work. As someone else pointed out,
pickthe value as needed, whether that's 10, 100, 1000, or whatever. But issuing 1000 lines of "\copy file" sort of
commandsat a time isn't a big deal by itself. OTOH, you have a good point that 1000 could be too much work for the
serverto handle, especially if the "-1" flag is also used. As always: test, test, test... 😊
 

Kevin
This e-mail transmission, and any documents, files or previous e-mail messages attached to it, may contain confidential
information.If you are not the intended recipient, or a person responsible for delivering it to the intended recipient,
youare hereby notified that any disclosure, distribution, review, copy or use of any of the information contained in or
attachedto this message is STRICTLY PROHIBITED. If you have received this transmission in error, please immediately
notifyus by reply e-mail, and destroy the original transmission and its attachments without reading them or saving them
todisk. Thank you.
 

pgsql-general by date:

Previous
From: Rob Sargent
Date:
Subject: Re: Loading 500m json files to database
Next
From: Rob Sargent
Date:
Subject: Re: Loading 500m json files to database