Re: 10K vs 15k rpm for analytics - Mailing list pgsql-performance

From Kevin Grittner
Subject Re: 10K vs 15k rpm for analytics
Date
Msg-id 4B960BD4020000250002FA5D@gw.wicourts.gov
Whole thread Raw
In response to Re: 10K vs 15k rpm for analytics  ("Pierre C" <lists@peufeu.com>)
List pgsql-performance
"Pierre C" <lists@peufeu.com> wrote:
> Greg Smith <greg@2ndquadrant.com> wrote:

>> I'm curious what you feel those weaknesses are.
>
> Handling lots of small files, especially deleting them, is really
> slow on XFS.
> Databases don't care about that.

I know of at least one exception to that -- when we upgraded and got
a newer version of the kernel where XFS has write barriers on by
default, some database transactions which were creating and dropping
temporary tables in a loop became orders of magnitude slower.  Now,
that was a silly approach to getting the data that was needed and I
helped them rework the transactions, but something which had worked
acceptably suddenly didn't anymore.

Since we have a BBU hardware RAID controller, we can turn off write
barriers safely, at least according to this page:

http://xfs.org/index.php/XFS_FAQ#Q._Should_barriers_be_enabled_with_storage_which_has_a_persistent_write_cache.3F

This reduces the penalty for creating and deleting lots of small
files.

-Kevin

pgsql-performance by date:

Previous
From: david@lang.hm
Date:
Subject: Re: 10K vs 15k rpm for analytics
Next
From: Merlin Moncure
Date:
Subject: Re: Out of shared memory in postgres 8.4.2 and locks