Thread: BUG #14197: ERROR: character with byte sequence 0x81 in encoding "WIN1252" has no equivalent in encoding "UTF8"
BUG #14197: ERROR: character with byte sequence 0x81 in encoding "WIN1252" has no equivalent in encoding "UTF8"
From
sheri.bhavani@cognizant.com
Date:
VGhlIGZvbGxvd2luZyBidWcgaGFzIGJlZW4gbG9nZ2VkIG9uIHRoZSB3ZWJz aXRlOgoKQnVnIHJlZmVyZW5jZTogICAgICAxNDE5NwpMb2dnZWQgYnk6ICAg ICAgICAgIGJoYXZhbmkgc2hlcmkKRW1haWwgYWRkcmVzczogICAgICBzaGVy aS5iaGF2YW5pQGNvZ25pemFudC5jb20KUG9zdGdyZVNRTCB2ZXJzaW9uOiA5 LjUuMwpPcGVyYXRpbmcgc3lzdGVtOiAgIFdpbmRvd3M3CkRlc2NyaXB0aW9u OiAgICAgICAgCgpJIGhhdmUgbWlncmF0ZWQgZnJvbSBwb3N0Z3JlU1FMIDcg dG8gcG9zdGdyZVNRTCA5LjUuMyBhbmQgdGh1cyBnZXR0aW5nIHRoaXMKZXJy b3IuUGxlYXNlIGhlbHAgbWUgdG8gcmVzb2x2ZSBpdC4KCg==
Re: BUG #14197: ERROR: character with byte sequence 0x81 in encoding "WIN1252" has no equivalent in encoding "UTF8"
From
"David G. Johnston"
Date:
On Thu, Jun 16, 2016 at 8:22 AM, <sheri.bhavani@cognizant.com> wrote: > The following bug has been logged on the website: > > Bug reference: 14197 > Logged by: bhavani sheri > Email address: sheri.bhavani@cognizant.com > PostgreSQL version: 9.5.3 > Operating system: Windows7 > Description: > > I have migrated from postgreSQL 7 to postgreSQL 9.5.3 and thus getting th= is > error.Please help me to resolve it. > I'd start with: Google: =E2=80=8B fixing character with byte sequence postgresql =E2=80=8BYou use the past tense here "I have migrated" - did the migration = succeed and you are getting errors during normal operations or has some aspect of your migration failed? David J.=E2=80=8B
SGksDQoNClRoZSBtaWdyYXRpb24gd2FzIHN1Y2Nlc3NmdWwgLg0KDQrigKIgICAgICAgICB3aGls ZSBjcmVhdGluZyBiYWNrdXAgZm9yIHRoZSBkYXRhYmFzZSB3ZSB1c2VkIHBvc3RncmVzcWwgNyB2 ZXJzaW9uIC4NCg0K4oCiICAgICAgICAgV2hpbGUgcmVzdG9yaW5nIHRoZSBzYW1lIGJhY2t1cCB1 c2luZyBwb3N0Z3JlU1FMIDkuNS4zIHdlIGFyZSBmYWNpbmcgdGhlIG1lbnRpb25lZCBwcm9ibGVt Lg0KDQrigKIgICAgICAgICBFUlJPUjogY2hhcmFjdGVyIHdpdGggYnl0ZSBzZXF1ZW5jZSAweDgx IGluIGVuY29kaW5nICJXSU4xMjUyIiBoYXMgbm8gZXF1aXZhbGVudCBpbiBlbmNvZGluZyAiVVRG OCIgaXMgdGhyb3duIGluIHBvc3RncmVTUUwgOS41LjMgLg0KUGxlYXNlIGhlbHAgbWUgb3V0IHRv IHJlc29sdmUgdGhpcyBlcnJvci4NCg0KUmVnYXJkcywNCkJoYXZhbmkNCg0KRnJvbTogYmhhdmFu aSwgc2hlcmkgKENvZ25pemFudCkNClNlbnQ6IEZyaWRheSwgSnVuZSAxNywgMjAxNiAxMDoyNyBB TQ0KVG86IEJoYW51IFByaXlhIChDb2duaXphbnQpIChCaGFudS5Qcml5YTNAY29nbml6YW50LmNv bSkNClN1YmplY3Q6IEZXOiBbQlVHU10gQlVHICMxNDE5NzogRVJST1I6IGNoYXJhY3RlciB3aXRo IGJ5dGUgc2VxdWVuY2UgMHg4MSBpbiBlbmNvZGluZyAiV0lOMTI1MiIgaGFzIG5vIGVxdWl2YWxl bnQgaW4gZW5jb2RpbmcgIlVURjgiDQoNCg0KDQpGcm9tOiBEYXZpZCBHLiBKb2huc3RvbiBbbWFp bHRvOmRhdmlkLmcuam9obnN0b25AZ21haWwuY29tXQ0KU2VudDogRnJpZGF5LCBKdW5lIDE3LCAy MDE2IDEwOjIxIEFNDQpUbzogYmhhdmFuaSwgc2hlcmkgKENvZ25pemFudCkNClN1YmplY3Q6IFJl OiBbQlVHU10gQlVHICMxNDE5NzogRVJST1I6IGNoYXJhY3RlciB3aXRoIGJ5dGUgc2VxdWVuY2Ug MHg4MSBpbiBlbmNvZGluZyAiV0lOMTI1MiIgaGFzIG5vIGVxdWl2YWxlbnQgaW4gZW5jb2Rpbmcg IlVURjgiDQoNClBsZWFzZSBkaXJlY3QgcmVwbGllcyB0byB0aGUgbGlzdC4NCg0KT24gRnJpZGF5 LCBKdW5lIDE3LCAyMDE2LCA8c2hlcmkuYmhhdmFuaUBjb2duaXphbnQuY29tPG1haWx0bzpzaGVy aS5iaGF2YW5pQGNvZ25pemFudC5jb20+PiB3cm90ZToNCkhpLA0KDQpUaGUgbWlncmF0aW9uIHdh cyBzdWNjZXNzZnVsIC4NCg0K4oCiICAgICAgICAgd2hpbGUgY3JlYXRpbmcgYmFja3VwIGZvciB0 aGUgZGF0YWJhc2Ugd2UgdXNlZCBwb3N0Z3Jlc3FsIDcgdmVyc2lvbiAuDQoNCuKAoiAgICAgICAg IFdoaWxlIHJlc3RvcmluZyB0aGUgc2FtZSBiYWNrdXAgdXNpbmcgcG9zdGdyZVNRTCA5LjUuMyB3 ZSBhcmUgZmFjaW5nIHRoZSBtZW50aW9uZWQgcHJvYmxlbS4NCg0K4oCiICAgICAgICAgRVJST1I6 IGNoYXJhY3RlciB3aXRoIGJ5dGUgc2VxdWVuY2UgMHg4MSBpbiBlbmNvZGluZyAiV0lOMTI1MiIg aGFzIG5vIGVxdWl2YWxlbnQgaW4gZW5jb2RpbmcgIlVURjgiIGlzIHRocm93biBpbiBwb3N0Z3Jl U1FMIDkuNS4zIC4NClBsZWFzZSBoZWxwIG1lIG91dCB0byByZXNvbHZlIHRoaXMgZXJyb3IuDQoN ClJlZ2FyZHMsDQpCaGF2YW5pDQoNCg0KRnJvbTogRGF2aWQgRy4gSm9obnN0b24gW21haWx0bzpk YXZpZC5nLmpvaG5zdG9uQGdtYWlsLmNvbTxqYXZhc2NyaXB0Ol9lKCU3QiU3RCwnY3ZtbCcsJ2Rh dmlkLmcuam9obnN0b25AZ21haWwuY29tJyk7Pl0NClNlbnQ6IFRodXJzZGF5LCBKdW5lIDE2LCAy MDE2IDY6NTggUE0NClRvOiBiaGF2YW5pLCBzaGVyaSAoQ29nbml6YW50KQ0KQ2M6IHBnc3FsLWJ1 Z3NAcG9zdGdyZXNxbC5vcmc8amF2YXNjcmlwdDpfZSglN0IlN0QsJ2N2bWwnLCdwZ3NxbC1idWdz QHBvc3RncmVzcWwub3JnJyk7Pg0KU3ViamVjdDogUmU6IFtCVUdTXSBCVUcgIzE0MTk3OiBFUlJP UjogY2hhcmFjdGVyIHdpdGggYnl0ZSBzZXF1ZW5jZSAweDgxIGluIGVuY29kaW5nICJXSU4xMjUy IiBoYXMgbm8gZXF1aXZhbGVudCBpbiBlbmNvZGluZyAiVVRGOCINCg0KT24gVGh1LCBKdW4gMTYs IDIwMTYgYXQgODoyMiBBTSwgPHNoZXJpLmJoYXZhbmlAY29nbml6YW50LmNvbTxqYXZhc2NyaXB0 Ol9lKCU3QiU3RCwnY3ZtbCcsJ3NoZXJpLmJoYXZhbmlAY29nbml6YW50LmNvbScpOz4+IHdyb3Rl Og0KVGhlIGZvbGxvd2luZyBidWcgaGFzIGJlZW4gbG9nZ2VkIG9uIHRoZSB3ZWJzaXRlOg0KDQpC dWcgcmVmZXJlbmNlOiAgICAgIDE0MTk3DQpMb2dnZWQgYnk6ICAgICAgICAgIGJoYXZhbmkgc2hl cmkNCkVtYWlsIGFkZHJlc3M6ICAgICAgc2hlcmkuYmhhdmFuaUBjb2duaXphbnQuY29tPGphdmFz Y3JpcHQ6X2UoJTdCJTdELCdjdm1sJywnc2hlcmkuYmhhdmFuaUBjb2duaXphbnQuY29tJyk7Pg0K UG9zdGdyZVNRTCB2ZXJzaW9uOiA5LjUuMw0KT3BlcmF0aW5nIHN5c3RlbTogICBXaW5kb3dzNw0K RGVzY3JpcHRpb246DQoNCkkgaGF2ZSBtaWdyYXRlZCBmcm9tIHBvc3RncmVTUUwgNyB0byBwb3N0 Z3JlU1FMIDkuNS4zIGFuZCB0aHVzIGdldHRpbmcgdGhpcw0KZXJyb3IuUGxlYXNlIGhlbHAgbWUg dG8gcmVzb2x2ZSBpdC4NCg0KSSdkIHN0YXJ0IHdpdGg6DQoNCkdvb2dsZTogIOKAiw0KIGZpeGlu ZyBjaGFyYWN0ZXIgd2l0aCBieXRlIHNlcXVlbmNlIHBvc3RncmVzcWwNCg0K4oCLWW91IHVzZSB0 aGUgcGFzdCB0ZW5zZSBoZXJlICJJIGhhdmUgbWlncmF0ZWQiIC0gZGlkIHRoZSBtaWdyYXRpb24g c3VjY2VlZCBhbmQgeW91IGFyZSBnZXR0aW5nIGVycm9ycyBkdXJpbmcgbm9ybWFsIG9wZXJhdGlv bnMgb3IgaGFzIHNvbWUgYXNwZWN0IG9mIHlvdXIgbWlncmF0aW9uIGZhaWxlZD8NCg0KRGF2aWQg Si7igIsNCg0KVGhpcyBlLW1haWwgYW5kIGFueSBmaWxlcyB0cmFuc21pdHRlZCB3aXRoIGl0IGFy ZSBmb3IgdGhlIHNvbGUgdXNlIG9mIHRoZSBpbnRlbmRlZCByZWNpcGllbnQocykgYW5kIG1heSBj b250YWluIGNvbmZpZGVudGlhbCBhbmQgcHJpdmlsZWdlZCBpbmZvcm1hdGlvbi4gSWYgeW91IGFy ZSBub3QgdGhlIGludGVuZGVkIHJlY2lwaWVudChzKSwgcGxlYXNlIHJlcGx5IHRvIHRoZSBzZW5k ZXIgYW5kIGRlc3Ryb3kgYWxsIGNvcGllcyBvZiB0aGUgb3JpZ2luYWwgbWVzc2FnZS4gQW55IHVu YXV0aG9yaXplZCByZXZpZXcsIHVzZSwgZGlzY2xvc3VyZSwgZGlzc2VtaW5hdGlvbiwgZm9yd2Fy ZGluZywgcHJpbnRpbmcgb3IgY29weWluZyBvZiB0aGlzIGVtYWlsLCBhbmQvb3IgYW55IGFjdGlv biB0YWtlbiBpbiByZWxpYW5jZSBvbiB0aGUgY29udGVudHMgb2YgdGhpcyBlLW1haWwgaXMgc3Ry aWN0bHkgcHJvaGliaXRlZCBhbmQgbWF5IGJlIHVubGF3ZnVsLiBXaGVyZSBwZXJtaXR0ZWQgYnkg YXBwbGljYWJsZSBsYXcsIHRoaXMgZS1tYWlsIGFuZCBvdGhlciBlLW1haWwgY29tbXVuaWNhdGlv bnMgc2VudCB0byBhbmQgZnJvbSBDb2duaXphbnQgZS1tYWlsIGFkZHJlc3NlcyBtYXkgYmUgbW9u aXRvcmVkLg0KVGhpcyBlLW1haWwgYW5kIGFueSBmaWxlcyB0cmFuc21pdHRlZCB3aXRoIGl0IGFy ZSBmb3IgdGhlIHNvbGUgdXNlIG9mIHRoZSBpbnRlbmRlZCByZWNpcGllbnQocykgYW5kIG1heSBj b250YWluIGNvbmZpZGVudGlhbCBhbmQgcHJpdmlsZWdlZCBpbmZvcm1hdGlvbi4gSWYgeW91IGFy ZSBub3QgdGhlIGludGVuZGVkIHJlY2lwaWVudChzKSwgcGxlYXNlIHJlcGx5IHRvIHRoZSBzZW5k ZXIgYW5kIGRlc3Ryb3kgYWxsIGNvcGllcyBvZiB0aGUgb3JpZ2luYWwgbWVzc2FnZS4gQW55IHVu YXV0aG9yaXplZCByZXZpZXcsIHVzZSwgZGlzY2xvc3VyZSwgZGlzc2VtaW5hdGlvbiwgZm9yd2Fy ZGluZywgcHJpbnRpbmcgb3IgY29weWluZyBvZiB0aGlzIGVtYWlsLCBhbmQvb3IgYW55IGFjdGlv biB0YWtlbiBpbiByZWxpYW5jZSBvbiB0aGUgY29udGVudHMgb2YgdGhpcyBlLW1haWwgaXMgc3Ry aWN0bHkgcHJvaGliaXRlZCBhbmQgbWF5IGJlIHVubGF3ZnVsLiBXaGVyZSBwZXJtaXR0ZWQgYnkg YXBwbGljYWJsZSBsYXcsIHRoaXMgZS1tYWlsIGFuZCBvdGhlciBlLW1haWwgY29tbXVuaWNhdGlv bnMgc2VudCB0byBhbmQgZnJvbSBDb2duaXphbnQgZS1tYWlsIGFkZHJlc3NlcyBtYXkgYmUgbW9u aXRvcmVkLg0K
Re: BUG #14197: ERROR: character with byte sequence 0x81 in encoding "WIN1252" has no equivalent in encoding "UTF8"
From
John R Pierce
Date:
On 6/16/2016 10:08 PM, sheri.bhavani@cognizant.com wrote: > ·ERROR: character with byte sequence 0x81 in encoding "WIN1252" has no > equivalent in encoding "UTF8" is thrown in postgreSQL 9.5.3 . per https://en.wikipedia.org/wiki/Windows-1252 0x81 is not a valid character in encoding win1252, so it can't be converted to UTF8 you need to determine what field of which row of what table has that value in it and change it to something valid (perhaps 0x20 ?) before you can load this data into a UTF8 database. -- john r pierce, recycling bits in santa cruz
Re: BUG #14197: ERROR: character with byte sequence 0x81 in encoding "WIN1252" has no equivalent in encoding "UTF8"
From
"Albin, Lloyd P"
Date:
SSBoYXZlIHNlbnQgdGhlIHNoZXJpLmJoYXZhbmkgYSBwcmVzZW50YXRpb24gSSB3cm90ZSBvbiBo b3cgdG8gZml4IHRoaXMgaXNzdWUgYWZ0ZXIgd2UgcmFuIGludG8gdGhlIHNhbWUgaXNzdWVzLg0K DQpXaGVuIEkgd2FzIHVwZ3JhZGluZyBvdXIgU1FMX0FTQ0lJIGZyb20gUG9zdGdyZXMgOS4yIHRv IDkuNCwgSSBmb3VuZCB0aGF0IHNvbWUgb2Ygb3VyIHF1ZXJpZXMgd291bGQgbm8gbG9uZ2VyIHdv cmsuIFRoaXMgaXMgZHVlIHRvIGNoYW5nZXMgaW4gdGhlIGludGVybmFsIGZ1bmN0aW9ucyBzbyB0 aGF0IGlmIHRoZXkgcnVuIGFjcm9zcyBtdWx0aXBsZSBlbmNvZGluZywgdGhleSB3aWxsIHRocm93 IGFuIGVycm9yLiBTbyB0aGlzIGZvcmNlZCB1cyB0byByZXZpc2l0IHRoZSBwcm9qZWN0IGZvciBj b252ZXJ0aW5nIGFsbCBvdXIgZGF0YSB0byBVVEY4LiBUaGUgcHJvYmxlbSB3YXMgZmluZGluZyBh bGwgdGhhdCBkYXRhIGFuZCBnZXR0aW5nIGl0IGNvbnZlcnRlZC4gV2UgaGFkIEFDU0lJLCBVVEY4 LCBMQVRJTjEsIGFuZCBXSU4xMjUyIGVuY29kaW5ncyB3aXRoaW4gb3VyIGRhdGFiYXNlIGFuZCBz b21ldGltZSBkaWZmZXJlbnQgZW5jb2RpbmdzIGZvciBkaWZmZXJlbnQgcm93cyBvZiBkYXRhIHdp dGhpbiB0aGUgc2FtZSB0YWJsZS4NCg0KSW4gdGhpcyBwcmVzZW50YXRpb24gSSB3aWxsIHNob3cg eW91IHRoZSBmdW5jdGlvbnMgdG8gd3JpdGUsIGNvZGUgc3VwcGxpZWQsIHRvIGZpbmQgYWxsIHRo ZSBub24tQVNDSUkgY2hhcmFjdGVycyBpbiB5b3VyIGRhdGFiYXNlIHNvIHRoYXQgeW91IGNhbiB0 aGVuIG1hbnVhbGx5IGZpZ3VyZSBvdXQgaG93IHRvIGJhY2t1cCBlYWNoIHNlY3Rpb24gb2YgZGF0 YS4gVGhlbiB3ZSB3aWxsIGNvdmVyIGJhY2tpbmcgdXAgYW5kIHJlc3RvcmluZyBlYWNoIG9mIHRo b3NlIHNlY3Rpb25zIG9mIGRhdGEuDQoNCklmIGFueW9uZSBlbHNlIGlzIGludGVyZXN0ZWQsIGRy b3AgbWUgYSBub3RlIGFuZCBJIHdpbGwgc2VuZCB5b3UgYSBjb3B5IG9mIHRoZSBwcmVzZW50YXRp b24uDQoNCi0tDQpMbG95ZCBBbGJpbg0KRGF0YWJhc2UgTWFuYWdlciAvIFN0YXRpc3RpY2FsIENl bnRlciBmb3IgSElWL0FJRFMgUmVzZWFyY2ggYW5kIFByZXZlbnRpb24gKFNDSEFSUCkgLyBsYWxi aW5AZnJlZGh1dGNoLm9yZyAvIEZyZWQgSHV0Y2ggLyBDdXJlcyBTdGFydCBIZXJlDQoNCkZyb206 IHBnc3FsLWJ1Z3Mtb3duZXJAcG9zdGdyZXNxbC5vcmcgW21haWx0bzpwZ3NxbC1idWdzLW93bmVy QHBvc3RncmVzcWwub3JnXSBPbiBCZWhhbGYgT2YgSm9obiBSIFBpZXJjZQ0KU2VudDogRnJpZGF5 LCBKdW5lIDE3LCAyMDE2IDE6MDQgQU0NClRvOiBzaGVyaS5iaGF2YW5pQGNvZ25pemFudC5jb207 IHBnc3FsLWJ1Z3NAcG9zdGdyZXNxbC5vcmcNClN1YmplY3Q6IFJlOiBbQlVHU10gQlVHICMxNDE5 NzogRVJST1I6IGNoYXJhY3RlciB3aXRoIGJ5dGUgc2VxdWVuY2UgMHg4MSBpbiBlbmNvZGluZyAi V0lOMTI1MiIgaGFzIG5vIGVxdWl2YWxlbnQgaW4gZW5jb2RpbmcgIlVURjgiDQoNCk9uIDYvMTYv MjAxNiAxMDowOCBQTSwgc2hlcmkuYmhhdmFuaUBjb2duaXphbnQuY29tPG1haWx0bzpzaGVyaS5i aGF2YW5pQGNvZ25pemFudC5jb20+IHdyb3RlOg0K4oCiICAgICAgICAgRVJST1I6IGNoYXJhY3Rl ciB3aXRoIGJ5dGUgc2VxdWVuY2UgMHg4MSBpbiBlbmNvZGluZyAiV0lOMTI1MiIgaGFzIG5vIGVx dWl2YWxlbnQgaW4gZW5jb2RpbmcgIlVURjgiIGlzIHRocm93biBpbiBwb3N0Z3JlU1FMIDkuNS4z IC4NCg0KcGVyIGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL1dpbmRvd3MtMTI1MiAgMHg4 MSBpcyBub3QgYSB2YWxpZCBjaGFyYWN0ZXIgaW4gZW5jb2Rpbmcgd2luMTI1Miwgc28gaXQgY2Fu J3QgYmUgY29udmVydGVkIHRvIFVURjgNCg0KeW91IG5lZWQgdG8gZGV0ZXJtaW5lIHdoYXQgZmll bGQgb2Ygd2hpY2ggcm93IG9mIHdoYXQgdGFibGUgaGFzIHRoYXQgdmFsdWUgaW4gaXQgYW5kIGNo YW5nZSBpdCB0byBzb21ldGhpbmcgdmFsaWQgKHBlcmhhcHMgMHgyMCA/KSBiZWZvcmUgeW91IGNh biBsb2FkIHRoaXMgZGF0YSBpbnRvIGEgVVRGOCBkYXRhYmFzZS4NCg0KDQoNCg0KLS0NCg0Kam9o biByIHBpZXJjZSwgcmVjeWNsaW5nIGJpdHMgaW4gc2FudGEgY3J1eg0K