Re: [GENERAL] [PERFORMANCE] expanding to SAN: which portion best to move - Mailing list pgsql-performance

From Greg Smith
Subject Re: [GENERAL] [PERFORMANCE] expanding to SAN: which portion best to move
Date
Msg-id 4DF10664.7020906@2ndQuadrant.com
Whole thread Raw
In response to Re: [PERFORMANCE] expanding to SAN: which portion best to move  (Willy-Bas Loos <willybas@gmail.com>)
Responses Re: [GENERAL] [PERFORMANCE] expanding to SAN: which portion best to move  (Robert Klemme <shortcutter@googlemail.com>)
List pgsql-performance
On 06/09/2011 07:43 AM, Willy-Bas Loos wrote:
Well, after reading your article i have been reading some materail about it on the internet, stating that separating indexes from data for performance benefits is a myth.
I found your comment " So then a single query will only ever access one of both at a time." very smart (no sarcasm there).
I also found a thread on AskTom that said mainly "the goal is to achieve even io." (that makes absolute sense)

The idea that separating indexes and tables from one another via a tablespace is inherently good is a myth.  Particularly nowadays, where the fastest part of a drive is nearly twice as fast as the slowest one in sequential transfers, and the ratio between sequential and random I/O is huge.  Trying to get clever about breaking out a tablespace is unlikely to outsmart what you'd get if you just let the OS deal with that stuff.

What is true is that when you have multiple tiers of storage speeds available, allocating the indexes and tables among them optimally is both difficult and potentially worthwhile.  A customer of mine has two drive arrays, one of which is about 50% faster than the other; second was added as expansion once the first filled.  Nowadays, both are 75% full, and I/O on each has to be carefully balanced.  Making sure the heavily hit indexes are on the fast array, and that less critical things are not placed there, is the difference between that site staying up or going down.

The hidden surprise in this problem for most people is the day they discover that *the* most popular indexes, the ones they figured had to go on the fastest storage around, are actually sitting in RAM all the time anyway.  It's always fun and sad at the same time to watch someone spend a fortune on some small expensive storage solution, move their most performance critical data to it, and discover nothing changed.  Some days that works great; others, it's no faster all, because that data was already in memory.

-- 
Greg Smith   2ndQuadrant US    greg@2ndQuadrant.com   Baltimore, MD
PostgreSQL Training, Services, and 24x7 Support  www.2ndQuadrant.us
"PostgreSQL 9.0 High Performance": http://www.2ndQuadrant.com/books

pgsql-performance by date:

Previous
From: Greg Smith
Date:
Subject: Re: Triggering autovacuum
Next
From: Tatsuo Ishii
Date:
Subject: Re: Oracle v. Postgres 9.0 query performance