Re: invalid byte sequence for encoding "UTF8" - Mailing list pgsql-general

From Usama Dar
Subject Re: invalid byte sequence for encoding "UTF8"
Date
Msg-id ff0e67090711300201p1c30fc7anab75deed0ebcc705@mail.gmail.com
Whole thread Raw
In response to invalid byte sequence for encoding "UTF8"  (Glyn Astill <glynastill@yahoo.co.uk>)
List pgsql-general


On 11/30/07, Glyn Astill <glynastill@yahoo.co.uk > wrote:
Hi People,

I've setup a postgres 8.2 server and have a database setup with UTF8
encoding. I intend to read some of our legacy data into the table,
this legacy data is in ASCII format, and as far as I know is 8 bit
ASCII.

We have a migration tool from mertechdata.com to convert these files
that are in a DataFlex format into out postgres tables.

Some files convert over okay, and some come up with the error message
'invalid byte sequence for encoding "UTF8"'. the files that come up
with the error are created correctly and so are their index's, but as
soon as we come to insert the data we get this error.

Does anyone know why we're getting this error message? And uis there
a way to suppress it, or can we get around it using another format?

Our migration utility does ask us to select the correct encoding for
our database, and we select UTF8 but we still get the error. What do
you guys think? Possibly the migration tools fault?

I thought we may be able to get around it using SQL_ASCII encoding -
but it's ony 7 bit, so would we loose some data? Also our conversion
utility doesn't have the option to use SQL_ASCII.

Are there any more flexible formats we could use? I noticed we have
Latin 1-10 and ISO formats. Is there any reason why we shouldn't use
these?

Thanks
Glyn
 
 
Latin1 is a single byte encoding,  i can't think of any reason not to try it if the characters you have are valid ISO8859 characters. Probably posting  the hex codes of some characters which are failing will help.
     ___________________________________________________________
Yahoo! Answers - Got a question? Someone out there knows the answer. Try it
now.
http://uk.answers.yahoo.com/

---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
      choose an index scan if your joining column's datatypes do not
      match



--
Usama Munir Dar http://linkedin.com/in/usamadar
Consultant Architect
Cell:+92 321 5020666
Skype: usamadar

pgsql-general by date:

Previous
From: Dave Page
Date:
Subject: Re: 8.2.3: Server crashes on Windows using Eclipse/Junit
Next
From: Gregory Stark
Date:
Subject: Re: invalid byte sequence for encoding "UTF8"