Services
24×7×365 Technical Support
Migration to PostgreSQL
High Availability Deployment
Database Audit
Remote DBA for PostgreSQL
Products
Postgres Pro Enterprise
Postgres Pro Standard
Cloud Solutions
Postgres Extensions
Resources
Blog
Documentation
Webinars
Videos
Presentations
Community
Events
Training Courses
Books
Demo Database
Mailing List Archives
About
Leadership team
Partners
Customers
In the News
Press Releases
Press Info
Services
24×7×365 Technical Support
Migration to PostgreSQL
High Availability Deployment
Database Audit
Remote DBA for PostgreSQL
Products
Postgres Pro Enterprise
Postgres Pro Standard
Cloud Solutions
Postgres Extensions
Resources
Blog
Documentation
Webinars
Videos
Presentations
Community
Events
Training Courses
Books
Demo Database
Mailing List Archives
About
Leadership team
Partners
Customers
In the News
Press Releases
Press Info
Facebook
Downloads
Home
>
mailing lists
Thousands of partitions performance questions - Mailing list pgsql-general
From
Shai Cantor
Subject
Thousands of partitions performance questions
Date
April 29, 2019
08:12:41
Msg-id
CABJyNM58xvi+rhnhj-MmMvAXU8ShN6_Kz2c34DkzahzDk5pHEg@mail.gmail.com
Whole thread
Raw
Responses
Re: Thousands of partitions performance questions
(David Rowley <david.rowley@2ndquadrant.com>)
List
pgsql-general
Tree view
General
Our system gathers data from CI builds regarding a customer's code base
Data includes
type
methods/lines/branches A.K.A - code elements
files
Queries
The data is queried for a specific build only
Queries are aggregations on the code elements and files with some filtering and sorting
Volume
I expect to have about 1500 builds a day, 45000 builds a month
A build can have around 300000 code elements and around 30000 files
Retention
Thought about keeping 90 days of builds as retention
Plan
2 tables
code elements
files
create a partition for each build
each day delete partitions older than 90 days
create 2 schemas for each client
<customer-id> schema which holds the parent tables
<customer-id>_partitions schema that will hold the partitions
upon a new build
create a partition for the code elements table and for the files table in the "<customer-id>_partitions" schema
Questions
Will the db hold 135000 (45000 * 3 months) partitions under the assumption that
I query only 1 partition?
Should I model it differently in terms of schema, partitions etc.?
pgsql-general
by date:
Previous
From:
Tom Lane
Date:
29 April 2019, 07:12:53
Subject:
Re: Optimize pg_dump schema-only
Next
From:
David Rowley
Date:
29 April 2019, 08:46:43
Subject:
Re: Thousands of partitions performance questions
Есть вопросы? Напишите нам!
Соглашаюсь с условиями обработки персональных данных
I confirm that I have read and accepted PostgresPro’s
Privacy Policy
.
I agree to get Postgres Pro discount offers and other marketing communications.
✖
×
×
Everywhere
Documentation
Mailing list
List:
all lists
pgsql-general
pgsql-hackers
buildfarm-members
pgadmin-hackers
pgadmin-support
pgsql-admin
pgsql-advocacy
pgsql-announce
pgsql-benchmarks
pgsql-bugs
pgsql-chat
pgsql-cluster-hackers
pgsql-committers
pgsql-cygwin
pgsql-docs
pgsql-hackers-pitr
pgsql-hackers-win32
pgsql-interfaces
pgsql-jdbc
pgsql-jobs
pgsql-novice
pgsql-odbc
pgsql-patches
pgsql-performance
pgsql-php
pgsql-pkg-debian
pgsql-pkg-yum
pgsql-ports
pgsql-rrreviewers
pgsql-ru-general
pgsql-sql
pgsql-students
pgsql-testers
pgsql-translators
pgsql-www
psycopg
Period
anytime
within last day
within last week
within last month
within last 6 months
within last year
Sort by
date
reverse date
rank
Services
24×7×365 Technical Support
Migration to PostgreSQL
High Availability Deployment
Database Audit
Remote DBA for PostgreSQL
Products
Postgres Pro Enterprise
Postgres Pro Standard
Cloud Solutions
Postgres Extensions
Resources
Blog
Documentation
Webinars
Videos
Presentations
Community
Events
Training Courses
Books
Demo Database
Mailing List Archives
About
Leadership team
Partners
Customers
In the News
Press Releases
Press Info
By continuing to browse this website, you agree to the use of cookies. Go to
Privacy Policy
.
I accept cookies