Re: Loading 500m json files to database - Mailing list pgsql-general

On 3/23/20 5:23 PM, pinker wrote:
> it's a cloud and no plpythonu extension avaiable unfortunately

I presume Python itself is available, so would it not be possible to 
create a program that concatenates the files into batches and COPY(s) 
that data into Postgres using the Psycopg2 COPY functions:

https://www.psycopg.org/docs/usage.html#using-copy-to-and-copy-from

> 
> 
> 
> --
> Sent from: https://www.postgresql-archive.org/PostgreSQL-general-f1843780.html
> 
> 


-- 
Adrian Klaver
adrian.klaver@aklaver.com