Thread: Controlling Server status log download

Controlling Server status log download

From
"Little, Douglas"
Date:
<div class="Section1"><p class="MsoNormal"><font face="Arial" size="2"><span style="font-size:10.0pt;
font-family:Arial">Is there a way to turn off the download of the log when using server status. </span></font><p
class="MsoNormal"><fontface="Arial" size="2"><span style="font-size:10.0pt; 
font-family:Arial">Everytime I open the status module, it downloads the entire log,  which right now is over 500meg.
 </span></font><pclass="MsoNormal"><font face="Arial" size="2"><span style="font-size:10.0pt; 
font-family:Arial">Would be nice to cache this data to disk, or download only the last x minutes.</span></font><p
class="MsoNormal"><fontface="Arial" size="2"><span style="font-size:10.0pt; 
font-family:Arial"> </span></font><p class="MsoNormal"><font face="Arial" size="2"><span style="font-size:10.0pt;
font-family:Arial">Thanks</span></font><p class="MsoNormal"><font face="Arial" size="2"><span style="font-size:10.0pt;
font-family:Arial"> </span></font><p class="MsoNormal"><font face="Arial" size="2"><span style="font-size:10.0pt;
font-family:Arial"> </span></font><p class="MsoNormal"><strong><b><font face="Arial" size="2"><span style="font-size:
10.0pt;font-family:Arial">Doug Little</span></font></b></strong><p class="MsoNormal"><font face="Arial" size="2"><span
style="font-size:10.0pt;
font-family:Arial">Sr. Data Warehouse Architect | Enterprise Data Management | Orbitz Worldwide </span></font><p
class="MsoNormal"style="margin-right:-1.25in"><font face="Arial" size="2"><span
style="font-size:10.0pt;font-family:Arial">500W. Madison, Suite 1000  Chicago IL 60661| Office 312.260.2588 | Fax
312.894.5164| Cell 847-997-5741</span></font><h3 style="margin:0in;margin-bottom:.0001pt"><strong><b><font face="Arial"
size="2"><spanstyle="font-size:10.0pt;font-family:Arial;font-weight:normal"><a href="mailto:Douglas.Little@orbitz.com"
title="mailto:dlittle@orbitz.com"><b><span
style="font-weight:bold">Douglas.Little@orbitz.com</span></b></a></span></font></b></strong><span
class="MsoHyperlink"><u><fontcolor="blue"></font></u></span></h3><p><font face="Times New Roman" size="3"><span
style="font-size:12.0pt"> <imgborder="0" height="61" id="_x0000_i1025" src="cid:image001.jpg@01CAA719.AFC206F0"
width="83"/>  <a href="http://www.orbitz.com/" title="http://www.orbitz.com/"><font face="Arial" size="1"><span
style="font-size:
8.0pt;font-family:Arial"><span title="http://www.orbitz.com/">orbitz.com</span></span></font></a> <font
color="blue"><spanstyle="color:blue">|</span></font> <a href="http://www.ebookers.com/"
title="http://www.ebookers.com/"><fontface="Arial" size="1"><span style="font-size:8.0pt;font-family:Arial"><span
title="http://www.ebookers.com/">ebookers.com</span></span></font></a><font color="blue"><span
style="color:blue">|</span></font><a href="http://www.hotelclub.com/" title="http://www.hotelclub.com/"><font
face="Arial"size="1"><span style="font-size:8.0pt;font-family:Arial"><span
title="http://www.hotelclub.com/">hotelclub.com</span></span></font></a><font color="blue"><span
style="color:blue">|</span></font><a href="http://www.cheaptickets.com/" title="http://www.cheaptickets.com/"><font
face="Arial"size="1"><span style="font-size:8.0pt;font-family:Arial"><span
title="http://www.cheaptickets.com/">cheaptickets.com</span></span></font></a><font color="blue"><span
style="color:blue">|</span></font><a href="http://www.ratestogo.com/" title="http://www.ratestogo.com/"><font
face="Arial"size="1"><span style="font-size:8.0pt;font-family:Arial"><span
title="http://www.ratestogo.com/">ratestogo.com</span></span></font></a><fontcolor="blue"><span style="color:blue">
|</span></font><a href="http://www.asiahotels.com/" title="http://www.asiahotels.com/"><font face="Arial"
size="1"><spanstyle="font-size:8.0pt;font-family:Arial"><span
title="http://www.asiahotels.com/">asiahotels.com</span></span></font></a> </span></font><pclass="MsoNormal"><font
face="TimesNew Roman" size="3"><span style="font-size: 
12.0pt"> </span></font></div>

Re: Controlling Server status log download

From
Raymond O'Donnell
Date:
On 06/02/2010 16:46, Little, Douglas wrote:
> Is there a way to turn off the download of the log when using server status.
> Everytime I open the status module, it downloads the entire log,  which right now is over 500meg.
> Would be nice to cache this data to disk, or download only the last x minutes.

I think it would be a better idea to get your log under control - 500Mb
of log is rather big.... You should use logrotate or equivalent, or look
at the log-rotation options in postgresql.conf.

Ray.

-- 
Raymond O'Donnell :: Galway :: Ireland
rod@iol.ie


Re: Controlling Server status log download

From
Guillaume Lelarge
Date:
Le 06/02/2010 17:58, Raymond O'Donnell a écrit :
> On 06/02/2010 16:46, Little, Douglas wrote:
>> Is there a way to turn off the download of the log when using server status.
>> Everytime I open the status module, it downloads the entire log,  which right now is over 500meg.
>> Would be nice to cache this data to disk, or download only the last x minutes.
> 
> I think it would be a better idea to get your log under control - 500Mb
> of log is rather big.... You should use logrotate or equivalent, or look
> at the log-rotation options in postgresql.conf.
> 

Well, even if he used a 100MB, which is quite less, this is still a lot
to download. I agree with Douglas that we should at least add an option
to control this behaviour.


-- 
Guillaume.http://www.postgresqlfr.orghttp://dalibo.com


Re: Controlling Server status log download

From
"Little, Douglas"
Date:
Morning,
You guys are great!   I love the responsiveness.  So much better than we get from our paid vendor.

The Dba is setting log to 200meg.  So, yes it's still a lot to download.

I'd like to see a function that would disable the log download.  Most of the time I'm looking it's to investigate
queriesthat are poorly performing.  
The log feature is currently interfering with this use.

Thanks
doug

-----Original Message-----
From: Guillaume Lelarge [mailto:guillaume@lelarge.info]
Sent: Saturday, February 06, 2010 5:08 PM
To: rod@iol.ie
Cc: Little, Douglas; pgadmin-support@postgresql.org
Subject: Re: [pgadmin-support] Controlling Server status log download

Le 06/02/2010 17:58, Raymond O'Donnell a écrit :
> On 06/02/2010 16:46, Little, Douglas wrote:
>> Is there a way to turn off the download of the log when using server status.
>> Everytime I open the status module, it downloads the entire log,  which right now is over 500meg.
>> Would be nice to cache this data to disk, or download only the last x minutes.
>
> I think it would be a better idea to get your log under control - 500Mb
> of log is rather big.... You should use logrotate or equivalent, or look
> at the log-rotation options in postgresql.conf.
>

Well, even if he used a 100MB, which is quite less, this is still a lot
to download. I agree with Douglas that we should at least add an option
to control this behaviour.


--
Guillaume.http://www.postgresqlfr.orghttp://dalibo.com


Re: Controlling Server status log download

From
Raymond O'Donnell
Date:
On 07/02/2010 16:40, Little, Douglas wrote:
> Morning, You guys are great!   I love the responsiveness.  So much
> better than we get from our paid vendor.

Heh heh - even when suggestions like mine aren't all that helpful! :-)

> I'd like to see a function that would disable the log download.  Most
> of the time I'm looking it's to investigate queries that are poorly
> performing. The log feature is currently interfering with this use.

That being the case, are you doing a lot of EXPLAIN ANALYZEs? If so, it
might be easier to do these directly in a terminal window via psql,
rather than using pgAdmin.

Ray.


-- 
Raymond O'Donnell :: Galway :: Ireland
rod@iol.ie


Re: Controlling Server status log download

From
"Little, Douglas"
Date:
Ray,
Only explains when we run into a trouble query.  It's a large data warehouse in greenplum.  So I think we're running
over1m sql's a day now. 

I actually think the pgadmin window does a good job visually depicting the explain.  Haven't used it all that much, but
beingnew to PG. pgadmin helps a lot, since I'm too old to remember syntax.   


Cheers
-----Original Message-----
From: Raymond O'Donnell [mailto:rod@iol.ie]
Sent: Sunday, February 07, 2010 10:47 AM
To: Little, Douglas
Cc: Guillaume Lelarge; pgadmin-support@postgresql.org
Subject: Re: [pgadmin-support] Controlling Server status log download

On 07/02/2010 16:40, Little, Douglas wrote:
> Morning, You guys are great!   I love the responsiveness.  So much
> better than we get from our paid vendor.

Heh heh - even when suggestions like mine aren't all that helpful! :-)

> I'd like to see a function that would disable the log download.  Most
> of the time I'm looking it's to investigate queries that are poorly
> performing. The log feature is currently interfering with this use.

That being the case, are you doing a lot of EXPLAIN ANALYZEs? If so, it
might be easier to do these directly in a terminal window via psql,
rather than using pgAdmin.

Ray.


--
Raymond O'Donnell :: Galway :: Ireland
rod@iol.ie


Re: Controlling Server status log download

From
Guillaume Lelarge
Date:
Le 07/02/2010 17:40, Little, Douglas a écrit :
> Morning, 
> You guys are great!   I love the responsiveness.  So much better than we get from our paid vendor. 
> 
> The Dba is setting log to 200meg.  So, yes it's still a lot to download. 
> 
> I'd like to see a function that would disable the log download.  Most of the time I'm looking it's to investigate
queriesthat are poorly performing. 
 
> The log feature is currently interfering with this use. 
> 

Now that I had some time to look into the code, it seems you can disable
a report by clicking on its close button. Try for the log report, it
should work.


-- 
Guillaume.http://www.postgresqlfr.orghttp://dalibo.com