Inserts and bad performance - Mailing list pgsql-general

From Godfrin, Philippe E
Subject Inserts and bad performance
Date
Msg-id SA0PR15MB3933E7B425ADC5DC36D9A8CC82619@SA0PR15MB3933.namprd15.prod.outlook.com
Whole thread Raw
Responses Re: Inserts and bad performance  (Kenneth Marshall <ktm@rice.edu>)
Re: Inserts and bad performance  (Tom Lane <tgl@sss.pgh.pa.us>)
Re: Inserts and bad performance  (Gavin Roy <gavinr@aweber.com>)
Re: Inserts and bad performance  (Ron <ronljohnsonjr@gmail.com>)
List pgsql-general

Greetings

I am inserting a large number of rows, 5,10, 15 million. The python code commits every 5000 inserts. The table has partitioned children.

 

At first, when there were a low number of rows inserted, the inserts would run at a good clip – 30 – 50K inserts per second. Now, after inserting oh say 1.5 Billion rows, the insert rate has dropped to around 5000 inserts per second. I dropped the unique index , rebuilt the other indexes and no change. The instance is 16 vcpu and 64GB ram.

 

I’m perplexed, I can’t see to find any reason for the slow down…

Thanks,

pg

 

Phil Godfrin | Database Administration

NOV

NOV US | Engineering Data

9720 Beechnut St | Houston, Texas 77036

M  281.825.2311

E   Philippe.Godfrin@nov.com

 

pgsql-general by date:

Previous
From: Aleš Zelený
Date:
Subject: Re: RPM package issue
Next
From: Kenneth Marshall
Date:
Subject: Re: Inserts and bad performance