Re: [RFC] nodeToString format and exporting the SQL parser - Mailing list pgsql-hackers

Jehan-Guillaume (ioguix) de Rorthais wrote:
> A simple example of a tokenizer is the php one:
>   http://fr.php.net/token_get_all
> 
> And here is a basic example which return pseudo rows here :
> 
> => TOKENIZE $script$
>     SELECT 1;
>     UPDATE test SET "a"=2;
>   $script$;
> 
>    type      | pos |   value  | line
> - -------------+-----+----------+------
>  SQL_COMMAND | 1   | 'SELECT' |   1
>  CONSTANT    | 8   | '1'      |   1
>  DELIMITER   | 9   | ';'      |   1
>  SQL_COMMAND | 11  | 'UPDATE' |   2
>  IDENTIFIER  | 18  | 'test'   |   2
>  SQL_KEYWORD | 23  | 'SET'    |   2
>  IDENTIFIER  | 27  | '"a"'    |   2
>  OPERATOR    | 30  | '='      |   2
>  CONSTANT    | 31  | '1'      |   2

Sounds useful to me, though as a function like suggested in a later
email.

--  Bruce Momjian  <bruce@momjian.us>        http://momjian.us EnterpriseDB
http://enterprisedb.com