Thread: How many billion rows of data I can store in PostgreSQL RDS.

How many billion rows of data I can store in PostgreSQL RDS.

From
github kran
Date:
Hello Pgsql-General,

We have currently have around 6 TB of data and have plans to move some historic datainto RDS of about close to 1 TB of data. The total rows in partitioned tables is around 6 billion rows today and have plans to keep the data long term which would be around 5-8 billion rows per year. 

So i short my use case is to keep data of 8 billion rows of data every year and store atleast 16 billion of rows for every 2 years. 
  1. How many billion rows does RDS handle ?. This data would be exposed by AP's accessing this data.
Appreciate you reply on this.
Thank you.

Re: How many billion rows of data I can store in PostgreSQL RDS.

From
Adrian Klaver
Date:
On 2/21/19 9:08 PM, github kran wrote:
> Hello Pgsql-General,
> 
> We have currently have around 6 TB of data and have plans to move some 
> historic datainto RDS of about close to 1 TB of data. The total rows in 
> partitioned tables is around 6 billion rows today and have plans to keep 
> the data long term which would be around 5-8 billion rows per year.
> 
> So i short my use case is to keep data of 8 billion rows of data every 
> year and store atleast 16 billion of rows for every 2 years.
> 
>  1. How many billion rows does RDS handle ?. This data would be exposed
>     by AP's accessing this data.
> 
> Appreciate you reply on this.

This would be a question for AWS RDS support.

> Thank you.


-- 
Adrian Klaver
adrian.klaver@aklaver.com


Re: How many billion rows of data I can store in PostgreSQL RDS.

From
Michael Paquier
Date:
On Thu, Feb 21, 2019 at 09:14:24PM -0800, Adrian Klaver wrote:
> This would be a question for AWS RDS support.

And this depends also a lot on your schema, your column alignment and
the level of bloat of your relations..
--
Michael

Attachment

Re: How many billion rows of data I can store in PostgreSQL RDS.

From
Samuel Teixeira Santos
Date:
Hi all.


Taking advantage of the topic I would like to know the recommendations about how to update to a newer Postgres version having all that amount of data.

Anyone one could share your experience about?

Thanks in advance.

Regards,


Samuel


Re: How many billion rows of data I can store in PostgreSQL RDS.

From
Samuel Teixeira Santos
Date:
Just adding that my case it's not a Amazon RDS, it's common server, if I can say like that...

Re: How many billion rows of data I can store in PostgreSQL RDS.

From
github kran
Date:


On Fri, Feb 22, 2019 at 5:48 AM Samuel Teixeira Santos <arcanosam@gmail.com> wrote:
Just adding that my case it's not a Amazon RDS, it's common server, if I can say like that...
Aplologies I missed the point to mention that this is a question to PostgreSQL community. We are currently using PostgreSQL. (  Aurora Postgres RDS). I want to know what postgresql can handle in terms of limitations.

Thanks.

Re: How many billion rows of data I can store in PostgreSQL RDS.

From
Adrian Klaver
Date:
On 2/22/19 4:46 AM, github kran wrote:
> 
> 
> On Fri, Feb 22, 2019 at 5:48 AM Samuel Teixeira Santos 
> <arcanosam@gmail.com <mailto:arcanosam@gmail.com>> wrote:
> 
>     Just adding that my case it's not a Amazon RDS, it's common server,
>     if I can say like that...
> 
> Aplologies I missed the point to mention that this is a question to 
> PostgreSQL community. We are currently using PostgreSQL. (  Aurora 
> Postgres RDS). I want to know what postgresql can handle in terms of 
> limitations.

Aurora Postgres is a fork of the community version:

https://aws.amazon.com/rds/aurora/

"Amazon Aurora is a MySQL and PostgreSQL-compatible relational database 
built for the cloud, ..."

You will need to ask the folks that created the fork(AWS) what it's 
capabilities are.

> 
> Thanks.


-- 
Adrian Klaver
adrian.klaver@aklaver.com