Re: 10K vs 15k rpm for analytics - Mailing list pgsql-performance

Scott Marlowe wrote:
> On Tue, Mar 2, 2010 at 1:51 PM, Yeb Havinga <yebhavinga@gmail.com> wrote:
>
>> With 24 drives it'll probably be the controller that is the limiting factor
>> of bandwidth. Our HP SAN controller with 28 15K drives delivers 170MB/s at
>> maximum with raid 0 and about 155MB/s with raid 1+0. So I'd go for the 10K
>> drives and put the saved money towards the controller (or maybe more than
>> one controller).
>>
>
> That's horrifically bad numbers for that many drives.  I can get those
> numbers for write performance on a RAID-6 on our office server.  I
> wonder what's making your SAN setup so slow?
>
Pre scriptum:
A few minutes ago I mailed detailed information in the same thread but
as reply to an earlier response - it tells more about setup and gives
results of a raid1+0 test.

I just have to react to "horrifically bad" and "slow" :-) : The HP san
can do raid5 on 28 disks also on about 155MBps:

28 disks devided into 7 logical units with raid5, orion results are
below. Please note that this time I did sequential large io. The mixed
read/write MBps maximum here is comparable: around 155MBps.

regards,
Yeb Havinga


ORION VERSION 10.2.0.1.0

Commandline:
-run advanced -testname msa -num_disks 24 -size_small 4 -size_large 1024
-type seq -simulate concat -verbose -write 50 -duration 15 -matrix
detailed -cache_size 256

This maps to this test:
Test: msa
Small IO size: 4 KB
Large IO size: 1024 KB
IO Types: Small Random IOs, Large Sequential Streams
Number of Concurrent IOs Per Stream: 4
Force streams to separate disks: No
Simulated Array Type: CONCAT
Write: 50%
Cache Size: 256 MB
Duration for each Data Point: 15 seconds
Small Columns:,      0,      1,      2,      3,      4,      5,
6,     12,     18,     24,     30,     36,     42,     48,     54,
60,     66,     72,     78,     84,     90,     96,    102,    108,
114,    120
Large Columns:,      0,      1,      2,      3,      4,      8,
12,     16,     20,     24,     28,     32,     36,     40,     44,     48
Total Data Points: 416

Name: /dev/sda1 Size: 109256361984
Name: /dev/sdb1 Size: 109256361984
Name: /dev/sdc1 Size: 109256361984
Name: /dev/sdd1 Size: 109256361984
Name: /dev/sde1 Size: 109256361984
Name: /dev/sdf1 Size: 109256361984
Name: /dev/sdg1 Size: 109256361984
7 FILEs found.

Maximum Large MBPS=157.75 @ Small=0 and Large=1
Maximum Small IOPS=3595 @ Small=66 and Large=1
Minimum Small Latency=2.81 @ Small=1 and Large=0

MBPS matrix

Large/Small,      0,      1,      2,      3,      4,      5,      6,
12,     18,     24,     30,     36,     42,     48,     54,     60,
66,     72,     78,     84,     90,     96,    102,    108,    114,    120
          1, 157.75, 156.47, 153.56, 153.45, 144.87, 141.78, 140.60,
112.45,  95.23,  72.80,  80.59,  36.91,  29.76,  42.86,  41.82,  33.87,
34.07,  45.62,  42.97,  26.37,  42.85,  45.49,  44.47,  37.26,  45.67,
36.18
          2, 137.58, 128.48, 125.78, 133.85, 120.12, 127.86, 127.05,
119.26, 121.23, 115.00, 117.88, 114.35, 108.61, 106.55,  83.50,  78.61,
92.67,  96.01,  44.02,  70.60,  62.84,  46.52,  69.18,  51.84,  57.19,
59.62
          3, 143.10, 134.92, 139.30, 138.62, 137.85, 146.17, 140.41,
138.48,  76.00, 138.17, 123.48, 137.45, 126.51, 137.11,  91.94,  90.33,
129.97,  45.35, 115.92,  89.60, 137.22,  72.46,  89.95,  77.40, 119.17,
82.09
          4, 138.47, 133.74, 129.99, 122.33, 126.75, 125.22, 132.30,
120.41, 125.88, 132.21,  96.92, 115.70, 131.65,  66.34, 114.06, 113.62,
116.91,  96.97,  98.69, 127.16, 116.67, 111.53, 128.97,  92.38, 118.14,
78.31
          8, 126.59, 127.92, 115.51, 125.02, 123.29, 111.94, 124.31,
125.71, 134.48, 126.40, 127.93, 125.36, 121.75, 121.75, 127.17, 116.51,
121.44, 121.12, 112.32, 121.55, 127.93, 124.86, 118.04, 114.59, 121.72,
114.79
         12, 112.40, 122.58, 107.61, 125.42, 128.04, 123.80, 127.17,
127.70, 122.37,  96.52, 115.36, 124.49, 124.07, 129.31, 124.62, 124.23,
105.58, 123.55, 115.67, 120.59, 125.61, 123.57, 121.43, 121.45, 121.44,
113.64
         16, 108.88, 119.79, 123.80, 120.55, 120.02, 121.66, 125.71,
122.19, 125.77, 122.27, 119.55, 118.44, 120.51, 104.66,  97.55, 115.43,
101.45, 108.99, 122.30, 100.45, 105.82, 119.56, 121.26, 126.59, 119.54,
115.09
         20, 103.88, 122.95, 115.86, 114.59, 121.13, 108.52, 116.90,
121.10, 113.91, 108.20, 111.51, 125.64, 117.57, 120.86, 117.66, 100.40,
104.88, 103.15,  98.10, 104.86, 104.69, 102.99, 121.81, 107.22, 122.68,
106.43
         24, 102.64, 102.33, 112.95, 110.63, 108.00, 111.53, 124.33,
103.17, 108.16, 112.63,  97.42, 106.22, 102.54, 117.46, 100.66,  99.01,
104.46,  99.02, 116.02, 112.49, 119.05, 104.03, 102.40, 102.44, 111.15,
99.51
         28, 101.12, 102.76, 114.14, 109.72, 120.63, 118.09, 119.85,
113.80, 116.58, 110.24, 101.45, 110.31, 116.06, 112.04, 121.63,  91.26,
98.88, 101.55, 104.51, 116.43, 112.98, 119.46, 120.08, 109.46, 106.29,
96.69
         32, 103.41, 117.33, 101.33, 102.29, 102.58, 116.18, 107.12,
114.63, 121.84,  95.14, 108.83,  99.82, 103.11,  99.36, 117.80,  94.91,
103.46, 103.97, 117.35, 100.51, 100.18, 101.98, 118.26, 115.03, 100.45,
107.90
         36,  99.90,  97.98, 100.94,  95.56, 118.76,  99.05, 114.02,
93.61, 117.68, 115.22, 114.40, 116.38, 100.38,  99.15, 108.66, 101.67,
106.64,  98.69, 111.99, 108.28,  99.62, 112.67, 118.80, 110.40, 118.86,
108.46
         40, 101.51, 103.38,  93.73, 121.69, 106.27, 104.09, 110.81,
105.83,  95.81, 101.47, 105.96, 113.26, 103.61, 114.26, 100.49, 102.35,
111.44,  95.09, 103.02, 106.21, 104.39, 118.31,  96.73, 109.79, 103.71,
99.70
         44, 101.17, 107.22, 107.50, 115.19, 104.16, 108.93, 101.62,
111.82, 110.66, 104.13, 109.68, 103.20,  92.04, 104.70, 102.30, 117.28,
106.37, 100.42, 107.81, 105.31, 110.21, 108.66, 116.05, 105.55, 100.64,
106.67
         48, 101.00, 104.13, 114.00,  99.55, 107.46, 113.29, 114.32,
108.75, 100.11,  99.89, 104.81, 107.36, 102.93, 106.43, 101.98, 103.15,
101.30, 113.94, 103.07, 102.40,  95.38, 111.33,  93.89, 112.30, 103.58,
101.82

iops matrix

Large/Small,      1,      2,      3,      4,      5,      6,     12,
18,     24,     30,     36,     42,     48,     54,     60,     66,
72,     78,     84,     90,     96,    102,    108,    114,    120
          0,    355,    639,    875,   1063,   1230,   1366,   1933,
2297,   2571,   2750,   2981,   3394,   3027,   3045,   3036,   3139,
3218,   3081,   3151,   3203,   3128,   3179,   3093,   3141,   3135
          1,     37,     99,    144,    298,    398,    488,   1183,
1637,   2069,   2268,   2613,   2729,   2860,   2983,   3119,   3595,
3065,   3077,   3036,   3008,   3039,   3030,   3067,   3138,   3041
          2,     22,     36,     44,    130,    112,     92,    271,
378,    579,    673,    903,   1091,   1131,   1735,   1612,   1809,
1236,   2316,   2302,   1410,   2467,   2526,   2692,   2606,   2625
          3,      5,     13,     18,     21,     27,     27,     56,
92,    162,    196,    209,    239,    309,    595,   1551,    611,
2408,   1034,    488,    401,   1226,   1700,   2490,   1516,   2435
          4,      8,     10,     33,     38,     53,     38,    137,
191,    165,    502,    369,    212,   1127,    654,   1069,    721,
643,   1046,    537,    803,   1093,    497,   1669,   1120,   1945
          8,      3,      8,      6,     15,     24,     19,     61,
47,     90,    139,    109,    174,    184,    154,    261,    294,
289,    460,    338,    199,    425,    433,    633,    475,    599
         12,      3,      7,      7,     10,     11,     12,     32,
74,     67,     91,     93,    120,    157,    158,    201,    191,
143,    220,    327,    217,    283,    276,    297,    336,    365
         16,      2,      3,      6,      6,     10,     11,     27,
35,     56,     52,     80,    100,     89,    118,    102,    140,
178,    158,    174,    188,    185,    243,    168,    235,    249
         20,      1,      3,      5,      6,      8,     11,     15,
30,     30,     54,     44,     70,     76,     87,    104,     79,
121,    115,    128,    135,    147,    158,    194,    184,    250
         24,      1,      2,      4,      5,      8,      6,     14,
21,     29,     36,     42,     50,     58,     61,     70,     64,
85,    102,    117,    120,    111,    126,    129,    170,    159
         28,      1,      2,      4,      3,      7,      7,     16,
19,     23,     30,     37,     51,     60,     58,     59,     65,
75,     76,     91,     83,    107,    103,    113,    120,    135
         32,      1,      2,      3,      3,      6,      6,     12,
17,     19,     28,     30,     31,     32,     44,     49,     57,
53,     82,     87,     80,     84,    106,    106,     96,     93
         36,      1,      2,      4,      5,      4,      7,      9,
15,     22,     27,     30,     32,     35,     43,     46,     48,
52,     67,     69,     54,     78,     87,     98,     92,    114
         40,      0,      2,      2,      3,      4,      5,     12,
12,     16,     24,     25,     29,     35,     36,     42,     51,
45,     55,     60,     61,     71,     67,     72,     77,     67
         44,      0,      2,      2,      3,      4,      4,     10,
12,     19,     20,     24,     24,     25,     32,     34,     40,
43,     58,     62,     60,     71,     75,     75,     68,     81
         48,      0,      1,      2,      5,      4,      4,     10,
14,     16,     18,     21,     23,     27,     31,     34,     37,
44,     42,     54,     48,     59,     54,     69,     65,     67