Re: log_statement and Parse/Bind - Mailing list pgsql-hackers

From Oliver Jowett
Subject Re: log_statement and Parse/Bind
Date
Msg-id 40B3EFE0.9090700@opencloud.com
Whole thread Raw
In response to Re: log_statement and Parse/Bind  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-hackers
Tom Lane wrote:
> Oliver Jowett <oliver@opencloud.com> writes:
> 
>>I notice that when using the extended query protocol, statement logging 
>>appears to happen only when a Parse message is received. This is less 
>>than ideal:
> 
> 
> I agree, but I didn't have time at the end of the 7.4 development cycle
> to work out what should happen.
> 
> I do not think that regurgitating the statement three times would make
> anyone very happy, so some thought has to go into what's appropriate.

Currently the statement-type-analysis and logging occur in 
pg_parse_query, which is called from:
  pg_parse_and_rewrite     from fmgr_sql_validator (parses for syntax/args/return types only)     from init_sql_fcache
(parsesfor syntax/args/return types only)  exec_simple_query (1)  exec_parse_message (2)  fmgr_sql_validator (parses
forsyntax only)  _SPI_execute (3)
 

Turning off logging in pg_parse_query only affects (1..3), the other 
cases we don't really want to log anyway (except perhaps in the case of 
an error).

For (1) we can log after the parse but before execution starts.
For (2) we can delay logging until the Execute message comes along; the 
original query text is stored in the portal.
For (3) we can delay logging until _SPI_execute_plan (or do it directly 
in _SPI_execute when plan == NULL); the original query text is stored in 
the _SPI_Plan.

Add a parse tree -> statement type helper function to do categorization 
of the parse trees (currently done in pg_parse_query). Store that type 
in the prepared statement (for exec_parse_message) or _SPI_Plan (for 
_SPI_execute) for later use when executing the query; exec_simple_query 
can use the result immediately.

This leaves only error handling. Currently, with log_statement = all 
statements get logged before parsing which is quite useful when tracking 
down parse errors. This doesn't work if we only log when the query is 
actually executed, since a query that doesn't parse can never get executed.

Maybe something like including the original query string as a field of 
errors encountered when parsing would do the trick? Or use an error 
callback to catch the error and log the statement before the real error 
is reported when log_statement = all?

-O


pgsql-hackers by date:

Previous
From: Oliver Jowett
Date:
Subject: Re: Timezone fun (bugs and a request)
Next
From: Christopher Kings-Lynne
Date:
Subject: Re: Optimizer Bug issue