Re: slow commits with heavy temp table usage in 8.4.0 - Mailing list pgsql-hackers

From Todd A. Cook
Subject Re: slow commits with heavy temp table usage in 8.4.0
Date
Msg-id 4A7B13BC.6020606@blackducksoftware.com
Whole thread Raw
In response to Re: slow commits with heavy temp table usage in 8.4.0  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: slow commits with heavy temp table usage in 8.4.0  (Alex Hunsaker <badalex@gmail.com>)
List pgsql-hackers
Tom Lane wrote:
>
> I took a look through the CVS history and verified that there were
> no post-8.4 commits that looked like they'd affect performance in
> this area.  So I think it's got to be a platform difference not a
> PG version difference.  In particular I think we are probably looking
> at a filesystem issue: how fast can you delete [...] 30000 files.

I'm still on Fedora 7, so maybe this will be motivation to upgrade.

FYI, on my 8.2.13 system, the test created 30001 files which were all
deleted during the commit.  On my 8.4.0 system, the test created 60001
files, of which 30000 were deleted at commit and 30001 disappeared
later (presumably during a checkpoint?).


> But I'm not sure
> if the use-case is popular enough to deserve such a hack.

FWIW, the full app was looping over a set of datasets.  On each iteration,
it computed some intermediate results into a temp table, generated several
reports from those intermediate results, and finally truncated the table
for the next iteration.

-- todd


pgsql-hackers by date:

Previous
From: "Kevin Grittner"
Date:
Subject: Re: the case for machine-readable error fields
Next
From: "Todd A. Cook"
Date:
Subject: Re: slow commits with heavy temp table usage in 8.4.0