Re: Just to give an idea ... - Mailing list pgsql-www

On Sat, 5 Jun 2004, Gavin M. Roy wrote:

> If we want to offset the load by moving pgfoundry to one of my servers
> temporarily until you guys get your new servers and what not in place,
> I'd be happy to host it, if it helps.

altho that is an option, I made some changes to the servers this weekend
that seem to be holding load down ... we'll see how the 'weekday traffic'
changes that ...

but, also, Jan Wieck took a scan through the schema for pgfoundry at
Andrew's request, and it looks like there are several areas for
improvement there ;(

  >
> Gavin
>
> On Sat, 5 Jun 2004 11:19:04 -0300 (ADT), Marc G. Fournier
> <scrappy@postgresql.org> wrote:
>>
>>
>> Top ten processes on mars (where pgfoundry and archives are located):
>>
>> USER      PID %CPU %MEM   VSZ  RSS  TT  STAT STARTED      TIME COMMAND
>> www     41463 17.3  0.1 12364 5808  ??  SJ   11:00AM   0:05.75 /usr/local/sbin/httpd
>> www     20583 13.5  0.1 12688 6172  ??  RJ    2:00PM 195:45.65 /usr/local/sbin/httpd
>> www     41053 12.2  0.1 12372 5840  ??  SJ   10:56AM   0:28.14 /usr/local/sbin/httpd
>> www     56570 12.3  0.3 21336 12012  ??  RJ   Wed11PM 264:32.06 /usr/local/sbin/httpd
>> www     56572 12.5  0.3 21388 12072  ??  RJ   Wed11PM 258:55.67 /usr/local/sbin/httpd
>> www     41792 11.9  0.1 12368 5800  ??  SJ   11:00AM   0:01.19 /usr/local/sbin/httpd
>> www     41778 10.5  0.1 12376 5824  ??  SJ   11:00AM   0:04.47 /usr/local/sbin/httpd
>> www     20582  9.0  0.2 13192 6752  ??  SJ    2:00PM 195:51.63 /usr/local/sbin/httpd
>> 60      41798  6.6  0.1 21012 2296  ??  SJ   11:00AM   0:00.38 lmtpd
>> scrappy 41795  6.4  0.0  2220 1408  ??  SJ   11:00AM   0:00.47 cleanup -z -t unix -u
>>
>> and, process map'ng to the VMs:
>>
>> # cat /proc/{41463,20583,41053,56570,56572,41792,41778,20582,41798,41795}/status
>> cat: /proc/41463/status: No such file or directory
>> httpd 11651,690738 nochan 80 80 80,80,80 svr5.postgresql.org
>> httpd 41,778660 select 80 80 80,80,80 svr5.postgresql.org
>> httpd 15453,319902 nochan 80 80 80,80,80 pgfoundry.org
>> httpd 15130,154111 nochan 80 80 80,80,80 pgfoundry.org
>> cat: /proc/41792/status: No such file or directory
>> cat: /proc/41778/status: No such file or directory
>> httpd 11656,301638 nochan 80 80 80,80,80 svr5.postgresql.org
>> lmtpd 0,365833 select 60 60 60,60,60 up4.com
>> cleanup 0,462244 select 1001 1001 1001,1001,1001,6 up4.com
>>
>> and all the high %CPU ones are postgresql.org related ...
>>
>> also, postgresql.org generates ~298GB of traffic per month, which accounts
>> for ~56% of all traffic out of the servers (and that isn't included what I
>> put onto our offsite server for ftp/bittorrent, it used to be ~75% of the
>> traffic), while hub.org (non client) generates ~175GB (or ~33%) ...
>>
>> Most (if not 90%) of the paying clients are static pages that are lucky to
>> generate 100MB of traffic (and note that traffic is all traffic,
>> mail/web/ssh/ftp/etc) ...
>>
>> The point: before accusing "hub clients" of loading the servers, realize
>> that ~50% of the resources are used by postgresql.org, not by clients ...
>>
>> ----
>> Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
>> Email: scrappy@hub.org           Yahoo!: yscrappy              ICQ: 7615664
>>
>> ---------------------------(end of broadcast)---------------------------
>> TIP 5: Have you checked our extensive FAQ?
>>
>>                http://www.postgresql.org/docs/faqs/FAQ.html
>>
>

----
Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org           Yahoo!: yscrappy              ICQ: 7615664