RE: PostgreSQL 12.8 Same Query Same Execution Plan Different Time - Mailing list pgsql-performance

From Michel SALAIS
Subject RE: PostgreSQL 12.8 Same Query Same Execution Plan Different Time
Date
Msg-id 008701d80dff$bbe3f510$33abdf30$@msym.fr
Whole thread Raw
In response to Re: PostgreSQL 12.8 Same Query Same Execution Plan Different Time  ("David G. Johnston" <david.g.johnston@gmail.com>)
List pgsql-performance

Michel SALAIS

De : David G. Johnston <david.g.johnston@gmail.com>
Envoyé : mercredi 19 janvier 2022 16:11
À : Ludwig Isaac Lim <ludz_lim@yahoo.com>
Cc : pgsql-performance@postgresql.org
Objet : Re: PostgreSQL 12.8 Same Query Same Execution Plan Different Time

 

On Wed, Jan 19, 2022 at 7:59 AM Ludwig Isaac Lim <ludz_lim@yahoo.com> wrote:


I noticed that different is actually in Nested Loop join. One is taking 2 minutes, other is taking 12 seconds. I find this puzzling as I assume the nested loop should be done in memory.

 

Everything is done in memory, but the data has to get there first (hence BUFFERS as you figured out below).

 


The disk is gp2 SDD so I'm even more baffled by this. What could be the factors that affect the speed of nested loop. I notice for that both loops the rows is 7780 and loops is 1. I don't think those are big numbers

 

The loops are ~= 400 and 6,000

 


It was only after the running the 2 queries that I realize I could do EXPLAIN (ANALYZE, BUFFERS), but I couldn't reproduce the slowness.

 

Did you (can you even in RDS) attempt to clear those buffers?  If the first query ran slowly because none of the data was in memory (which you don't know for certain because you didn't run with BUFFERS option then) then subsequent runs would indeed be faster (the implementation of shared buffers having fulfilled one of its major purposes in life).

 

I'll agree buffers for that query does not seem to account for nearly two minutes...though as RDS is a shared resource I'd probably chalk at least some of it to contention on the underlying hardware (disk likely being more problematic than memory).

 

David J.

Hi,

 

Another point to check is eventually IOPS…

It depends on the contracted service, If the quantity of IOPS is guaranteed or not. When it is not guaranteed and a sufficiently heavy load (in I/O) was executed for a while, the value of IOPS falls down dramatically and then you are sure to have performance problems…

 

Michel SALAIS

 

pgsql-performance by date:

Previous
From: "David G. Johnston"
Date:
Subject: Re: PostgreSQL 12.8 Same Query Same Execution Plan Different Time
Next
From: Valentin Janeiko
Date:
Subject: Slow query fixed by replacing equality with a nested query