Re: Uber migrated from Postgres to MySQL - Mailing list pgsql-general

From James Keener
Subject Re: Uber migrated from Postgres to MySQL
Date
Msg-id CAG8g3twjTudcdNkynR5SOT3CYwimnSxX0MjVQmHiYJ6LCfQzuQ@mail.gmail.com
Whole thread Raw
In response to Re: Uber migrated from Postgres to MySQL  (John R Pierce <pierce@hogranch.com>)
List pgsql-general
So, millions is a lot, but it's not difficult to get to a place where
you have thousands or tables.

Image a case in which census data and the associated geometries.
https://github.com/censusreporter/census-postgres has 22 surveys, each
with 230+ tables. That's 5000+ tables right there.  Now, the TIGER
tables for all of that is another 50 tables per year, so another 350
tables.

If these were to be partitioned by state, instead of all records for
all states in a single table, then we're looking at 270,000.

Jim

On Thu, Jul 28, 2016 at 12:48 AM, John R Pierce <pierce@hogranch.com> wrote:
> On 7/27/2016 9:39 PM, Jeff Janes wrote:
>>
>> That depends on how how many objects there are consuming that 1 TB.
>> With millions of small objects, you will have problems.  Not as many
>> in 9.5 as there were in 9.1, but still it does not scale linearly in
>> the number of objects.  If you only have thousands of objects, then as
>> far as I know -k works like a charm.
>
>
> millions of tables?  thats akin to having millions of classes in an object
> oriented program, seems a bit excessive.
>
>
>
> --
> john r pierce, recycling bits in santa cruz
>
>
>
>
> --
> Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-general


pgsql-general by date:

Previous
From: John R Pierce
Date:
Subject: Re: Uber migrated from Postgres to MySQL
Next
From: Jason Dusek
Date:
Subject: Re: Uber migrated from Postgres to MySQL