Re: New Copy Formats - avro/orc/parquet - Mailing list pgsql-general

From David G. Johnston
Subject Re: New Copy Formats - avro/orc/parquet
Date
Msg-id CAKFQuwbeLaUD9iXmUExNrOTmdZVqTFnaHc+LQGh0ge5xcnaLeQ@mail.gmail.com
Whole thread Raw
In response to New Copy Formats - avro/orc/parquet  (Nicolas Paris <niparisco@gmail.com>)
Responses Re: New Copy Formats - avro/orc/parquet  (Tomas Vondra <tomas.vondra@2ndquadrant.com>)
List pgsql-general
On Saturday, February 10, 2018, Nicolas Paris <niparisco@gmail.com> wrote:
Hello

I d'found useful to be able to import/export from postgres to those modern data
formats:
- avro (c writer=https://avro.apache.org/docs/1.8.2/api/c/index.html)
- parquet (c++ writer=https://github.com/apache/parquet-cpp)
- orc (all writers=https://github.com/apache/orc)

Something like :
COPY table TO STDOUT ORC;

Would be lovely.

This would greatly enhance how postgres integrates in big-data ecosystem.

 
It would be written "... with (format 'orc')" and your best bet would be to create an extension.  I don't think that having such code in core (or contrib) is desirable.

David J.

pgsql-general by date:

Previous
From: Nicolas Paris
Date:
Subject: Re: New Copy Formats - avro/orc/parquet
Next
From: Tomas Vondra
Date:
Subject: Re: New Copy Formats - avro/orc/parquet