Re: [PATCH] COPY .. COMPRESSED - Mailing list pgsql-hackers

From Stephen Frost
Subject Re: [PATCH] COPY .. COMPRESSED
Date
Msg-id 20130114160106.GJ16126@tamriel.snowman.net
Whole thread Raw
In response to Re: [PATCH] COPY .. COMPRESSED  (Simon Riggs <simon@2ndQuadrant.com>)
Responses Re: [PATCH] COPY .. COMPRESSED
Re: [PATCH] COPY .. COMPRESSED
List pgsql-hackers
* Simon Riggs (simon@2ndQuadrant.com) wrote:
> There is a new option being added to pre/post process data, so it
> seems like the best way to add new features - in general.

That structure appears to have no option for passing compressed data to
or from a client connection.  Instead, it actually overloads the typical
meaning for options sent to \copy (which, imv, is "run COPY on the server
with these options and have the results stored locally") to mean
something different (run part of the COPY command on the server and part
of it locally).

> Specifically, we do support compressed output so a simple patch to
> allow re-loading of the compressed data we generate does seem sensible
> and reasonable.

Right, we're already using gzip for pg_dump/pg_restore.  This just gives
an option to move that compression over to the server side.  Also, I'd
be happy to add support for other compression options.

I do like the idea of a generalized answer which just runs a
user-provided command on the server but that's always going to require
superuser privileges.
Thanks,
    Stephen

pgsql-hackers by date:

Previous
From: Thom Brown
Date:
Subject: Re: pg_ctl idempotent option
Next
From: Alvaro Herrera
Date:
Subject: Re: erroneous restore into pg_catalog schema