Re: Tuning for mid-size server - Mailing list pgsql-performance

From Anjan Dave
Subject Re: Tuning for mid-size server
Date
Msg-id 2F2E24372F10744588A27DEECC85FE04B676A0@vt-pe2550-001.vantage.vantage.com
Whole thread Raw
In response to Tuning for mid-size server  ("Anjan Dave" <adave@vantage.com>)
List pgsql-performance
Hopefully, i am not steering this into a different direction, but is there a way to find out how much sort memory each
queryis taking up, so that we can scale that up with increasing users?
 

THanks,
Anjan

    -----Original Message----- 
    From: scott.marlowe [mailto:scott.marlowe@ihs.com] 
    Sent: Tue 10/21/2003 1:33 PM 
    To: Josh Berkus 
    Cc: Anjan Dave; Richard Huxton; pgsql-performance@postgresql.org 
    Subject: Re: [PERFORM] Tuning for mid-size server
    
    

    On Tue, 21 Oct 2003, Josh Berkus wrote:
    
    > Anjan,
    >
    > > From what I know, there is a cache-row-set functionality that doesn't
    > > exist with the newer postgres...
    >
    > What?  PostgreSQL has always used the kernel cache for queries.
    >
    > > Concurrent users will start from 1 to a high of 5000 or more, and could
    > > ramp up rapidly. So far, with increased users, we have gone up to
    > > starting the JVM (resin startup) with 1024megs min and max (recommended
    > > by Sun) - on the app side.
    >
    > Well, just keep in mind when tuning that your calculations should be based on
    > *available* RAM, meaning RAM not used by Apache or the JVM.
    >
    > With that many concurrent requests, you'll want to be *very* conservative with
    > sort_mem; I might stick to the default of 1024 if I were you, or even lower
    > it to 512k.
    
    Exactly.  Remember, Anjan, that that if you have a single sort that can't
    fit in RAM, it will use the hard drive for temp space, effectively
    "swapping" on its own.  If the concurrent sorts run the server out of
    memory, the server will start swapping process, quite possibly the sorts,
    in a sort of hideous round robin death spiral that will bring your machine
    to its knees as the worst possible time, midday under load.  sort_mem is
    one of the small "foot guns" in the postgresql.conf file that people tend
    to pick up and go "huh, what's this do?" right before cranking it up.
    
    


pgsql-performance by date:

Previous
From: "Anjan Dave"
Date:
Subject: Re: Tuning for mid-size server
Next
From: "scott.marlowe"
Date:
Subject: RAID controllers etc... was: PostgreSQL data on a NAS device ?