Re: File Systems Compared - Mailing list pgsql-performance

At 10:40 AM 12/6/2006, Brian Wipf wrote:

All tests are with bonnie++ 1.03a

Main components of system:
16 WD Raptor 150GB 10000 RPM drives all in a RAID 10
ARECA 1280 PCI-Express RAID adapter with 1GB BB Cache (Thanks for the
recommendation, Ron!)
32 GB RAM
Dual Intel 5160 Xeon Woodcrest 3.0 GHz processors
OS: SUSE Linux 10.1

>xfs (with write cache disabled on disks):
>/usr/local/sbin/bonnie++ -d bonnie/ -s 64368:8k
>Version  1.03       ------Sequential Output------ --Sequential Input-
>--Random-
>                     -Per Chr- --Block-- -Rewrite- -Per Chr- --
> Block-- --Seeks--
>Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %
>CP  /sec %CP
>hulk4        64368M 90621  99 283916  35 105871  11 88569  97
>433890  23 644.5   0
>                     ------Sequential Create------ --------Random
>Create--------
>                     -Create-- --Read--- -Delete-- -Create-- --
> Read--- -Delete--
>               files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %
> CP  /sec %CP
>                  16 28435  95 +++++ +++ 28895  82 28523  91 +++++
> ++ + 24369  86
>hulk4,64368M,
>90621,99,283916,35,105871,11,88569,97,433890,23,644.5,0,16,28435,95,++
>+++,+++,28895,82,28523,91,+++++,+++,24369,86
>
>xfs (with write cache enabled on disks):
>/usr/local/sbin/bonnie++ -d bonnie -s 64368:8k
>Version  1.03       ------Sequential Output------ --Sequential Input-
>--Random-
>                     -Per Chr- --Block-- -Rewrite- -Per Chr- --
> Block-- --Seeks--
>Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %
>CP  /sec %CP
>hulk4        64368M 90861  99 348401  43 131887  14 89412  97
>432964  23 658.7   0
>                     ------Sequential Create------ --------Random
>Create--------
>                     -Create-- --Read--- -Delete-- -Create-- --
> Read--- -Delete--
>               files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %
> CP  /sec %CP
>                  16 28871  90 +++++ +++ 28923  91 30879  93 +++++
> ++ + 28012  94
>hulk4,64368M,
>90861,99,348401,43,131887,14,89412,97,432964,23,658.7,0,16,28871,90,++
>+++,+++,28923,91,30879,93,+++++,+++,28012,94
Hmmm.   Something is not right.  With a 16 HD RAID 10 based on 10K
rpm HDs, you should be seeing higher absolute performance numbers.

Find out what HW the Areca guys and Tweakers guys used to test the 1280s.
At LW2006, Areca was demonstrating all-in-cache reads and writes of
~1600MBps and ~1300MBps respectively along with RAID 0 Sustained
Rates of ~900MBps read, and ~850MBps write.

Luke, I know you've managed to get higher IO rates than this with
this class of HW.  Is there a OS or SW config issue Brian should
closely investigate?

Ron Peacetree