Thread: convert from latin1 to utf8

convert from latin1 to utf8

From
Marc Fromm
Date:

I need to convert a bunch of my databases to utf8 before I can migrate them to postgresql 8.4. Is there a command that during the pg_dumpall process the encoding can be changed from latin1 to utf8?

 

This is the error I get when migrating the databases from 8.1 to a machine running 8.4

psql:pgdbs:215: ERROR:  encoding LATIN1 does not match locale en_US.UTF-8

DETAIL:  The chosen LC_CTYPE setting requires encoding UTF8.

 

Thanks

Re: convert from latin1 to utf8

From
Scott Whitney
Date:
I needed both UTF8 and Latin-1. I accomplished this by initdb with the LOCALE set to C. That lets me create dbs "with template0 encoding='Latin-1'" as well as "encoding=UTF8," FWIW...


-------- Original message --------
From: Marc Fromm <Marc.Fromm@wwu.edu>
Date: 10/10/2013 5:39 PM (GMT-06:00)
To: pgsql-admin@postgresql.org
Subject: [ADMIN] convert from latin1 to utf8


I need to convert a bunch of my databases to utf8 before I can migrate them to postgresql 8.4. Is there a command that during the pg_dumpall process the encoding can be changed from latin1 to utf8?

 

This is the error I get when migrating the databases from 8.1 to a machine running 8.4

psql:pgdbs:215: ERROR:  encoding LATIN1 does not match locale en_US.UTF-8

DETAIL:  The chosen LC_CTYPE setting requires encoding UTF8.

 

Thanks

Re: convert from latin1 to utf8

From
Marc Fromm
Date:

Using locale=c worked. Thanks!!!

 

I did try creating the databases that were latin1 on the new server run 8.4 as utf8 and then do the restore (without using locale=c during intidb) and it almost worked. Most of the latin1 databases were imported with their tables and data. I don’t know what stopped the few that did not. There was a reported some utf8 error.

 

I was hoping to be able to have all the dbs convert to utf8 for consistency, but at least I have everything migrated.

 

From: Scott Whitney [mailto:scott@journyx.com]
Sent: Thursday, October 10, 2013 4:08 PM
To: Marc Fromm; pgsql-admin@postgresql.org
Subject: RE: [ADMIN] convert from latin1 to utf8

 

I needed both UTF8 and Latin-1. I accomplished this by initdb with the LOCALE set to C. That lets me create dbs "with template0 encoding='Latin-1'" as well as "encoding=UTF8," FWIW...


-------- Original message --------
From: Marc Fromm <Marc.Fromm@wwu.edu>
Date: 10/10/2013 5:39 PM (GMT-06:00)
To: pgsql-admin@postgresql.org
Subject: [ADMIN] convert from latin1 to utf8

I need to convert a bunch of my databases to utf8 before I can migrate them to postgresql 8.4. Is there a command that during the pg_dumpall process the encoding can be changed from latin1 to utf8?

 

This is the error I get when migrating the databases from 8.1 to a machine running 8.4

psql:pgdbs:215: ERROR:  encoding LATIN1 does not match locale en_US.UTF-8

DETAIL:  The chosen LC_CTYPE setting requires encoding UTF8.

 

Thanks