Re: break table into portions for writing to separate files - Mailing list pgsql-general

From Seb
Subject Re: break table into portions for writing to separate files
Date
Msg-id 874n19pafi.fsf@net82.ceos.umanitoba.ca
Whole thread Raw
In response to break table into portions for writing to separate files  (Seb <spluque@gmail.com>)
List pgsql-general
On Thu, 01 May 2014 21:12:46 +0200,
Torsten Förtsch <torsten.foertsch@gmx.net> wrote:

[...]

> # copy (select * from generate_series(1,1000)) to program 'split -l
> 100 - /tmp/xxx'; COPY 1000 # \q

> $ ls -l /tmp/xxxa* -rw------- 1 postgres postgres 292 May 1 19:08
> /tmp/xxxaa -rw------- 1 postgres postgres 400 May 1 19:08 /tmp/xxxab
> -rw------- 1 postgres postgres 400 May 1 19:08 /tmp/xxxac -rw------- 1
> postgres postgres 400 May 1 19:08 /tmp/xxxad -rw------- 1 postgres
> postgres 400 May 1 19:08 /tmp/xxxae -rw------- 1 postgres postgres 400
> May 1 19:08 /tmp/xxxaf -rw------- 1 postgres postgres 400 May 1 19:08
> /tmp/xxxag -rw------- 1 postgres postgres 400 May 1 19:08 /tmp/xxxah
> -rw------- 1 postgres postgres 400 May 1 19:08 /tmp/xxxai -rw------- 1
> postgres postgres 401 May 1 19:08 /tmp/xxxaj

> Each of those contains 100 lines.

Wonderful!  I didn't know about this 'PROGRAM' parameter for COPY
nowadays.  Although the SELECT is slow, the split will happen very
quickly this way, so this should be acceptable.

Thanks,

--
Seb

pgsql-general by date:

Previous
From: Torsten Förtsch
Date:
Subject: Re: break table into portions for writing to separate files
Next
From: Raymond O'Donnell
Date:
Subject: Re: Ubuntu Packages / Config Files