Re: Horizontal scalability/sharding - Mailing list pgsql-hackers

From Joshua D. Drake
Subject Re: Horizontal scalability/sharding
Date
Msg-id 55E5C22C.6080107@commandprompt.com
Whole thread Raw
In response to Re: Horizontal scalability/sharding  (Mark Kirkwood <mark.kirkwood@catalyst.net.nz>)
List pgsql-hackers
On 09/01/2015 02:58 AM, Mark Kirkwood wrote:
> On 01/09/15 21:41, Bruce Momjian wrote:

> I'm thinking that partitioning and sharding are two different things:
>
> Partitioning is about reducing the amount of table data accessed and
> also perhaps easing admin activities (archiving/removing old stuff etc).
>
> Sharding is a about parallelism and redundancy...copies of stuff in
> different places and concurrent access by virtue of it being on
> different nodes!

In our world, they are complimentary. Consider partitioning that uses 
FDW tables with proper plan push down etc....

>
> Now *maybe* FDW is a good way to approach this, but really would be nice
> to see a more rigorous analysis (I note that like XC and XL, Greenplum
> looked at the existing mechanisms around at the time and ended up
> writing their own). Now I'm aware that things have moved on - but I
> think there needs to be a proper discussion about design and what we
> think distributed data/sharding etc should provide *before* grabbing
> hold of FDW as *the answer*!

Agreed.

Sincerely,

Joshua D. Drake



-- 
Command Prompt, Inc. - http://www.commandprompt.com/  503-667-4564
PostgreSQL Centered full stack support, consulting and development.
Announcing "I'm offended" is basically telling the world you can't
control your own emotions, so everyone else should do it for you.



pgsql-hackers by date:

Previous
From: "Joshua D. Drake"
Date:
Subject: Re: Horizontal scalability/sharding
Next
From: "Shulgin, Oleksandr"
Date:
Subject: Re: On-demand running query plans using auto_explain and signals