Re: New Copy Formats - avro/orc/parquet - Mailing list pgsql-general

From Andres Freund
Subject Re: New Copy Formats - avro/orc/parquet
Date
Msg-id 20180211171653.nvb26tbu774tqgiy@alap3.anarazel.de
Whole thread Raw
In response to Re: New Copy Formats - avro/orc/parquet  (Tomas Vondra <tomas.vondra@2ndquadrant.com>)
Responses Re: New Copy Formats - avro/orc/parquet  (Nicolas Paris <niparisco@gmail.com>)
List pgsql-general
Hi,

On 2018-02-10 18:21:37 +0100, Tomas Vondra wrote:
> That is true, but the question is how significant the overhead is. If
> it's 50% then reducing it would make perfect sense. If it's 1% then no
> one if going to be bothered by it.

I think it's pretty clear that it's going to be way way much more than
1%. It's trivial to construct cases where input parsing / output
formatting takes the majority of the time. And a lot of that you're
going to be able to avoid with binary formats.

Greetings,

Andres Freund


pgsql-general by date:

Previous
From: Thiemo Kellner
Date:
Subject: Re: execute block like Firebird does
Next
From: Nicolas Paris
Date:
Subject: Re: New Copy Formats - avro/orc/parquet