Re: Mass-Data question - Mailing list pgsql-general

From Alvaro Herrera
Subject Re: Mass-Data question
Date
Msg-id Pine.LNX.4.33L2.0204161613120.5690-100000@aguila.protecne.cl
Whole thread Raw
In response to Re: Mass-Data question  (Boris Köster <koester@x-itec.de>)
List pgsql-general
On Tue, 16 Apr 2002, [ISO-8859-15] Boris Köster wrote:

> Normally it sounds not very complex to do parallelized
> reading/writing but getting the results in the right order that is a
> problem. Maybe I could collect data parallelized from several
> machines via threads, writing the content to a (new) machine (?) if the numer of rows is
> not higher than x rows to avoid disk-overrun. The advantage could be
> that if this works, its possible to use that feature with pgsql+mysql.

Maybe you can use dblink to retrieve the results from the various
"parallel servers" into one central server and then merge them (UNION,
maybe?). That would work for simple SELECTs, but when you have a couple
of triggers you start getting into trouble.

Obviously you would have to split UPDATEs and INSERTs appropiately.

Who knows, maybe you can even get it to actually work.

--
Alvaro Herrera (<alvherre[@]atentus.com>)
"On the other flipper, one wrong move and we're Fatal Exceptions"
(T.U.X.: Term Unit X  - http://www.thelinuxreview.com/TUX/)


pgsql-general by date:

Previous
From: Brett Schwarz
Date:
Subject: Re: Java as PG Procedural Language
Next
From: Tom Jenkins
Date:
Subject: Re: Large table update/vacuum PLEASE HELP!