Postgres Pro
Downloads
Home   >   mailing lists

Thread: clustering and denormalizing with PostgreSQL?

clustering and denormalizing with PostgreSQL?

From
Chirag Patel
Date:
My application is designed in such a way that the amount of data is expected to be enormous (in the terabytes). I would like to cluster the data and have the luxury of being able to slice up (denormalize) the database tables by user. In other words, users 1-50 and user 51-100 can be divided so that queries across users is not needed.
 
Does PostgresSQL or any third party add-ons allow this scaling to automatically occur? When I say automatically, I mean:
1.       New users are routed to a different database when the current database reaches a pre-defined capacity
2.       Denormalization logic is provided so that the querying across databases is transparent to the user
 
I’ve heard this feature described as “federation” or “horizontal scaling” in the O'Reilly book “Building Scalable Web Sites”
 
I’ve never done clustering  before so I’m clueless. Any ideas or better suggestions?
 
Thanks
Chirag

Re: clustering and denormalizing with PostgreSQL?

From
"Brian A. Seklecki"
Date:
On Sat, 2007-08-04 at 16:32 -0700, Chirag Patel wrote:


>  the database tables by user. In other words, users 1-50 and user
> 51-100 can be divided so that queries across users is not needed.
Chirag:

When you say "users", do you mean entities internal to your application,
or do you mean postgresql-aware users (e.g., a 1:1 ratio of:
Pgsql-User->[Intermediary Logic] -> [Table] -> [Database/Tablespace])

~BAS