Re: UTF8 with BOM support in psql - Mailing list pgsql-hackers

From Andrew Dunstan
Subject Re: UTF8 with BOM support in psql
Date
Msg-id 4B02E9E0.1010906@dunslane.net
Whole thread Raw
In response to Re: UTF8 with BOM support in psql  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: UTF8 with BOM support in psql
List pgsql-hackers

Tom Lane wrote:
> Andrew Dunstan <andrew@dunslane.net> writes:
>   
>> Peter Eisentraut wrote:
>>     
>>> Well, someone could implement UTF-16 or UTF-whatever as client encoding.
>>> But I have not heard of any concrete proposals about that.
>>>       
>
>   
>> Doesn't the nul byte problem make that seriously hard?
>>     
>
> Just about impossible.  It would require a protocol bump, and removal of
> C-style string usage *everywhere* on the client side.
>
> Again, this is something that might be more feasible with encoding
> conversion inside psql --- translating UTF16 to UTF8 immediately upon
> reading it from any external file would confine the problem to possibly
> manageable bounds.
>
>         
>   

Well, it might be a good idea to provide at least some support in libpq. 
Making each client do it from scratch seems a bit inefficient.

cheers

andrew


pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: UTF8 with BOM support in psql
Next
From: Pavel Stehule
Date:
Subject: Re: actualised funcs typmod patch