Re: [SQL] Slow Inserts Again - Mailing list pgsql-sql

From Frank Morton
Subject Re: [SQL] Slow Inserts Again
Date
Msg-id 070701be957a$59f46450$8355e5ce@base2inc.com
Whole thread Raw
Responses Re: [SQL] Slow Inserts Again
List pgsql-sql
>But the transaction boundaries wouldn't have anything to do with
>Frank's real problem, which is that the insertions are getting
>slower and slower.  There's no good reason for that; and other
>people are not reporting any comparable problems.  (Considering
>that we *have* been getting trouble reports for more-than-2-gig
>tables, it's clear that people are putting large amounts of data
>into 6.5; so it's not like Frank is stressing the system more
>than it has been before.)

I should have made it more clear. I am using 6.4.2 with the "limit"
addition.

>Frank, what does the memory usage of the backend that's processing
>this insertion look like; has it been growing steadily?  I'm wondering
>whether you could have a problem with poor malloc behavior, or some
>such.

Using "ps" there is only on process accumlating lots of time. One backend
process has accumulated 2036 minutes of cpu time. Using vmstat, it
looks like things are ok memory wise. Almost nothing swapped and
a few megabytes marked as free. The CPU is 0% idle. The whole system
is now starting to melt down, though. Even moving the mouse takes
a few seconds for it to move. But, looking around, I don't see any other
process doing anything really.

I'm up to 13 seconds now per insert.

I'm about to punt again and go back to figuring out how to make copy
work. At this point, I'd have to convert the insert statements to copy.

Thanks all for helping figure this out...

Frank






pgsql-sql by date:

Previous
From: Chris Bitmead
Date:
Subject: Re: [SQL] No DIVIDE Operator
Next
From: JT Kirkpatrick
Date:
Subject: convert text to varchar