Postgres Pro
Downloads
Home   >   mailing lists

Thread: monitoring TPS and IOPS

monitoring TPS and IOPS

From
"Pascal Laporte (plaporte)"
Date:
Hello,
In what ways are we able to pull information about transactions and I/O per second ?
For things like load testing we need this type of information. 
In Oracle we retrieve it from the AWR reports.
Are PG admins also looking at this data, and how is that collected/presented?
Cheers!

Re: monitoring TPS and IOPS

From
Albe Laurenz
Date:
Pascal Laporte wrote:
> In what ways are we able to pull information about transactions and I/O per second ?
> For things like load testing we need this type of information.
> In Oracle we retrieve it from the AWR reports.
> Are PG admins also looking at this data, and how is that collected/presented?

For operating system parameters like I/O and CPU load you have to use operating
system tools, like "sar" on UNIX.

For measuring things like TPS during a test run, I'd recommend pgBadger
(http://dalibo.github.io/pgbadger/).

Yours,
Laurenz Albe

Re: monitoring TPS and IOPS

From
"Pascal Laporte (plaporte)"
Date:
Laurenz. Thank you.
For IOPS when doing load testing we would like to tell if the IO requests made by the DB can be handled by the server.
In oracle this information is stored in tables and so wondering if similar data can be found in PG as well.
I’m not sure how feasible it will be using OS tools.
For TPS we will explore pgBadger.
Regards,
__
Pascal




On 27/05/15 10:43, "Albe Laurenz" <laurenz.albe@wien.gv.at> wrote:

>Pascal Laporte wrote:
>> In what ways are we able to pull information about transactions and I/O per second ?
>> For things like load testing we need this type of information.
>> In Oracle we retrieve it from the AWR reports.
>> Are PG admins also looking at this data, and how is that collected/presented?
>
>For operating system parameters like I/O and CPU load you have to use operating
>system tools, like "sar" on UNIX.
>
>For measuring things like TPS during a test run, I'd recommend pgBadger
>(http://dalibo.github.io/pgbadger/).
>
>Yours,
>Laurenz Albe

Re: monitoring TPS and IOPS

From
Guillaume Lelarge
Date:
2015-05-27 11:01 GMT+02:00 Pascal Laporte (plaporte) <plaporte@cisco.com>:
Laurenz. Thank you.
For IOPS when doing load testing we would like to tell if the IO requests made by the DB can be handled by the server.
In oracle this information is stored in tables and so wondering if similar data can be found in PG as well.
I’m not sure how feasible it will be using OS tools.

Make sure the database files are on a specific partition and it will definitely be possible with tools like iostat or sysstat/sar.

For TPS we will explore pgBadger.

You can also take a look at pg_stat_database (xact_commit and xact_rollback columns). pgCluu might help you there.
 
Regards,
__
Pascal




On 27/05/15 10:43, "Albe Laurenz" <laurenz.albe@wien.gv.at> wrote:

>Pascal Laporte wrote:
>> In what ways are we able to pull information about transactions and I/O per second ?
>> For things like load testing we need this type of information.
>> In Oracle we retrieve it from the AWR reports.
>> Are PG admins also looking at this data, and how is that collected/presented?
>
>For operating system parameters like I/O and CPU load you have to use operating
>system tools, like "sar" on UNIX.
>
>For measuring things like TPS during a test run, I'd recommend pgBadger
>(http://dalibo.github.io/pgbadger/).
>
>Yours,
>Laurenz Albe

--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



--

Re: monitoring TPS and IOPS

From
Kieren Scott
Date:
For benchmarking TPS, have a look at pgbench if you haven't already done so.


Kieren

> From: plaporte@cisco.com
> To: laurenz.albe@wien.gv.at; 
> Subject: Re: [ADMIN] monitoring TPS and IOPS
> Date: Wed, 27 May 2015 09:01:33 +0000
>
> Laurenz. Thank you.
> For IOPS when doing load testing we would like to tell if the IO requests made by the DB can be handled by the server.
> In oracle this information is stored in tables and so wondering if similar data can be found in PG as well.
> I’m not sure how feasible it will be using OS tools.
> For TPS we will explore pgBadger.
> Regards,
> __
> Pascal
>
>
>
>
> On 27/05/15 10:43, "Albe Laurenz" <laurenz.albe@wien.gv.at> wrote:
>
> >Pascal Laporte wrote:
> >> In what ways are we able to pull information about transactions and I/O per second ?
> >> For things like load testing we need this type of information.
> >> In Oracle we retrieve it from the AWR reports.
> >> Are PG admins also looking at this data, and how is that collected/presented?
> >
> >For operating system parameters like I/O and CPU load you have to use operating
> >system tools, like "sar" on UNIX.
> >
> >For measuring things like TPS during a test run, I'd recommend pgBadger
> >(http://dalibo.github.io/pgbadger/).
> >
> >Yours,
> >Laurenz Albe
>
> --
> Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-admin

Re: monitoring TPS and IOPS

From
Albe Laurenz
Date:
Pascal Laporte wrote:
> For IOPS when doing load testing we would like to tell if the IO requests made by the DB can be
> handled by the server.
> In oracle this information is stored in tables and so wondering if similar data can be found in PG as
> well.
> I’m not sure how feasible it will be using OS tools.

That works fine in my experience (which is on Linux).

I watch out for the I/O queue size, the service time and the I/O utilization.
When the queue size increases, it is an inication that the system cannot keep
up with the load.

Yours,
Laurenz Albe