Re: Problems with PG 9.3 - Mailing list pgsql-admin

From Dhruv Shukla
Subject Re: Problems with PG 9.3
Date
Msg-id CAFiWeJBWYueKF=BDyMeJAECJA39zr_YvSgf6F+Pf2=_FhKrdsg@mail.gmail.com
Whole thread Raw
In response to Re: Problems with PG 9.3  (jayknowsunix@gmail.com)
Responses Re: Problems with PG 9.3
List pgsql-admin
Right now we are doing is only logs where on each statement for a sql function we are raising an info.

This way we know which step its getting stuck. Today it got stuck on the insert statement.

And we ran the same SQL function after killing the process, it ran normal without any issues.

-Dhruv


On Fri, Aug 22, 2014 at 3:11 PM, <jayknowsunix@gmail.com> wrote:
Have you tried attaching strace to one the loaders? That might give a clue where it's getting stuck.
-
Jay

Sent from my iPad

> On Aug 22, 2014, at 3:23 PM, Dhruv Shukla <dhruvshukla82@gmail.com> wrote:
>
> Hello,
> We quite recently moved our production database from 8.4 to 9.3. Its been just 2 months and the features which it allows for parallel backup and recovery has been a great use for us.
> But with 9.3 we have also run into a lot of troubles.
>
> Some background:
> We run loaders to load data into the DB. These loaders are perl programs which run on a different server than the db server. The amount of data loaded each day is pretty high.
>
> Problem:
> Some of the loaders are performing in a bad way. they get stuck or EOF happens on client connection and things just dies. There is one piece which gets stuck daily ... but once killed runs normal.
>
> One of the episode of today one of the loader got stuck for 2hr 15 min. I killed the whole process, restarted it and things ran within 10 mins. What I observed was the DB load hadnt changed or shifted significantly between the killing and the end of the program. At first we were thinking it was loaders but now it looks as if its the postgres database.
>
> The piece where it was stuck for 2hrs was it was trying to insert 37K rows in a 500K row table, which is pretty small considering PG potential. But the bottleneck here we cant solve it.
>
>
> Kindly help me find the solution, or the right place to dig into to find the exact problem, its been troubling some of our loaders for quite some time now.
>
> Please let me know if you need further information regarding the settings on our DB server.
>
> --
> Regards
> Dhruv



--
Regards
Dhruv
404-551-2578

pgsql-admin by date:

Previous
From: jayknowsunix@gmail.com
Date:
Subject: Re: Problems with PG 9.3
Next
From: Emmanuel Massawe
Date:
Subject: Job Opportunity.