Re: PSQL performance - TPS - Mailing list pgsql-performance

From Imre Samu
Subject Re: PSQL performance - TPS
Date
Msg-id CAJnEWwnSS9Kfbef2Xe2g8z8QzEbFNGGrK4ehzYKKFiOt2wNp6g@mail.gmail.com
Whole thread Raw
In response to PSQL performance - TPS  (Shital A <brightuser2019@gmail.com>)
List pgsql-performance
> Application as a whole is expected to give an throughput of 100k transactions per sec. 
> On this env(8core cpu, 16GB) what is the TPS that we can expect? 

as a reference - maybe you can reuse/adapt  the "TechEmpower Framework Benchmarks" tests - and compare your PG9.6+hardware results.

The new TechEmpower Framework Benchmarks  [2019-07-09 Round 18]
* reference numbers: https://www.techempower.com/benchmarks/#section=data-r18&hw=ph&test=update
* source code: https://github.com/TechEmpower/FrameworkBenchmarks
* PG11 config: https://github.com/TechEmpower/FrameworkBenchmarks/blob/master/toolset/databases/postgres/postgresql.conf
* java frameworks: https://github.com/TechEmpower/FrameworkBenchmarks/tree/master/frameworks/Java

> We have tested with a simple Java code firing insert

As I see - There are lot of java framework - and sometimes 10x difference in performance :
https://www.techempower.com/benchmarks/#section=data-r18&hw=ph&test=update

"Responses per second at 20 updates per request, Dell R440 Xeon Gold + 10 GbE"
( "Intel Xeon Gold 5120 CPU (14c28t) , 32 GB of memory, and an enterprise SSD. Dedicated Cisco 10-gigabit Ethernet switch")
*  java + PG11 results:   low:126 -> high:21807

"Responses per second at 20 updates per request, Azure D3v2 instances" 
*  java + PG11 results:  low:329 -> high:2975

best,
  Imre



Shital A <brightuser2019@gmail.com> ezt írta (időpont: 2019. aug. 1., Cs, 5:11):
Hello,

We are working on development of an application with postgresql 9.6 as backend. Application as a whole is expected to give an throughput of 100k transactions per sec. The transactions are received by DB from component firing DMLs in ad-hoc fashion i.e. the commits are fired after random numbers of transaction like 2,3,4. There is no bulk loading of records. DB should have HA setup in active passive streaming replication. We are doing a test setup on a 8-core machine having 16 GB RAM. Actual HW will be better.  

Need help in:
1. On this env(8core cpu, 16GB) what is the TPS that we can expect? We have tested with a simple Java code firing insert and commit in a loop on a simple table with one column. We get 1200 rows per sec. If we increase threads RPS decrease.

2. We have tuned some DB params like shared_buffers, sync_commit off, are there any other pointers to tune DB params?


Thanks. 

pgsql-performance by date:

Previous
From: Shital A
Date:
Subject: Re: PSQL performance - TPS
Next
From: Thomas Kellerer
Date:
Subject: Strange runtime partition pruning behaviour with 11.4