Re: UTF8 with BOM support in psql - Mailing list pgsql-hackers

From Bruce Momjian
Subject Re: UTF8 with BOM support in psql
Date
Msg-id 200910200558.n9K5wwM11713@momjian.us
Whole thread Raw
In response to UTF8 with BOM support in psql  (Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>)
Responses Re: UTF8 with BOM support in psql
Re: UTF8 with BOM support in psql
List pgsql-hackers
Itagaki Takahiro wrote:
> UTF8 encoding text files with BOM (Byte Order Mark) are commonly
> used in Windows, though BOM was designed for UTF16 text originally.
> However, psql cannot read such format even if we set client encoding
> to UTF8. Is it worth supporting those format in psql?
> 
> When psql opens a file with -f or \i, it checks first 3 bytes of the
> file. If they are BOM, discard the 3 bytes and change client encoding
> to UTF8 automatically.
> 
> Is this change reasonable? Comments welcome.

Seems there is community support for accepting BOM:
http://archives.postgresql.org/pgsql-hackers/2009-09/msg01625.php

Should I add this as a TODO item?

--  Bruce Momjian  <bruce@momjian.us>        http://momjian.us EnterpriseDB
http://enterprisedb.com
 + If your life is a hard drive, Christ can be your backup. +


pgsql-hackers by date:

Previous
From: Peter Eisentraut
Date:
Subject: Re: Could postgres be much cleaner if a future release skipped backward compatibility?
Next
From: Itagaki Takahiro
Date:
Subject: Re: UTF8 with BOM support in psql