Re: New Copy Formats - avro/orc/parquet - Mailing list pgsql-general

From Nicolas Paris
Subject Re: New Copy Formats - avro/orc/parquet
Date
Msg-id 20180211205735.nt6auxazit42qmcs@gmail.com
Whole thread Raw
In response to Re: New Copy Formats - avro/orc/parquet  (Andres Freund <andres@anarazel.de>)
Responses Re: New Copy Formats - avro/orc/parquet
List pgsql-general
Le 11 févr. 2018 à 21:53, Andres Freund écrivait :
> On 2018-02-11 21:41:26 +0100, Nicolas Paris wrote:
> > I have also the storage and network transfers overhead in mind:
> > All those new formats are compressed; this is not true for current
> > postgres BINARY format and obviously text based format. By experience,
> > the binary format is 10 to 30% larger than the text one. On the
> > contrary, an ORC file can be up to 10 times smaller than a text base
> > format.
> 
> That seems largely irrelevant when arguing about using PROGRAM though,
> right?
> 

Indeed those storage and network transfers are only considered versus
CSV/BINARY format. No link with PROGRAM aspect.


pgsql-general by date:

Previous
From: Andres Freund
Date:
Subject: Re: New Copy Formats - avro/orc/parquet
Next
From: Andres Freund
Date:
Subject: Re: New Copy Formats - avro/orc/parquet