Re: speed up full table scan using psql - Mailing list pgsql-general

From Adrian Klaver
Subject Re: speed up full table scan using psql
Date
Msg-id dba5964e-e9fb-dddd-328c-6add2b9993cf@aklaver.com
Whole thread Raw
In response to Re: speed up full table scan using psql  (Lian Jiang <jiangok2006@gmail.com>)
Responses Re: speed up full table scan using psql
List pgsql-general
On 5/31/23 13:57, Lian Jiang wrote:
> The command is: psql $db_url -c "copy (select row_to_json(x_tmp_uniq) 
> from public.mytable x_tmp_uniq) to stdout"

What is taking the stdout and what it is it doing?

> postgres version:  14.7
> Does this mean COPY and java CopyManager may not help since my psql 
> command already uses copy?
> 
> Regarding pg_dump, it does not support json format which means extra 
> work is needed to convert the supported format to jsonl (or parquet) so 
> that they can be imported into snowflake. Still exploring but want to 
> call it out early. Maybe 'custom' format can be parquet?
> 
> 
> Thanks
> Lian

-- 
Adrian Klaver
adrian.klaver@aklaver.com




pgsql-general by date:

Previous
From: Thorsten Glaser
Date:
Subject: Re: speed up full table scan using psql
Next
From: Lian Jiang
Date:
Subject: Re: speed up full table scan using psql