Re: errors on restoring postgresql binary dump to glusterfs - Mailing list pgsql-general

From Liang Ma
Subject Re: errors on restoring postgresql binary dump to glusterfs
Date
Msg-id CALPERycGgxM0wiLnXBSWmBScORAKL7PpVsc6bD7prdMNknjjYg@mail.gmail.com
Whole thread Raw
In response to Re: errors on restoring postgresql binary dump to glusterfs  (Magnus Hagander <magnus@hagander.net>)
Responses Re: errors on restoring postgresql binary dump to glusterfs
List pgsql-general
Hi Magnus,

Thank you for answering my post.

Please see comments on your answer below.

On Fri, May 4, 2012 at 3:58 AM, Magnus Hagander <magnus@hagander.net> wrote:
> On Mon, Apr 30, 2012 at 8:34 PM, Liang Ma <ma.satops@gmail.com> wrote:
>> Hi There,
>>
>> While trying to restore a ~700GM binary dump by command
>>
>> pg_restore -d dbdata < sampledbdata-20120327.pgdump
>>
>> I encountered following errors repeatedly
>>
>> pg_restore: [archiver (db)] Error from TOC entry 2882463; 2613
>> 10267347 BLOB 10267347 sdmcleod
>> pg_restore: [archiver (db)] could not execute query: ERROR:
>> unexpected data beyond EOF in block 500 of relation base/16386/11743
>> HINT:  This has been seen to occur with buggy kernels; consider
>> updating your system.
>
> Note the message right here...
>
> There may be further indications in the server log about what's wrong.
>

The server's logs in message file were clean.


>> The server runs Ubuntu server 10.04 LTS with postgresql upgraded to
>> version 9.1.3-1~lucid. The postgresql data directory is located in a
>> glusterfs mounted directory to a replicated volume vol-2
>
> I assume you don't have more than one node actually *accessing* the
> data directory at the same time, right?
>

Yes, you are right. I just set up this glusterfs and postgresql server
with two nodes for testing purpose. There was no other gluster
filesystem access activity at the time I tried to restore the
postgresql dump. Do you know if postgresql recommends any other
cluster filesystem, or it may not like cluster filesystem at all?


> Even with that said, I haven't heard of anybody running PostgreSQL on
> glusterfs, and I'm not sure it fulfills the basic requirements that
> PostgreSQL has on a filesystem. In particular, the messages above
> about a buggy kernel certainly indicates that there is a problem with
> the filesystem.
>
>> I think this may have someting to do with glusterfs, because when I
>> restore the same dump to a same ubuntu 10.04 server with postgresql
>> upgraded to the same 9.1.3-1~lucid located in a local ext4 filesystem,
>> the pg_restore went well without a single error.
>
> Yes, it certainly sounds like that. You probably need to bring it up
> with the glusterfs folks...
>

I posted to glusterfs mailing list at the same time but haven't got
any feedback yet. I think it is more likely related to glusterfs, but
would like to know if any other postgresql users have similar
experience or ideas.

> --
>  Magnus Hagander
>  Me: http://www.hagander.net/
>  Work: http://www.redpill-linpro.com/

Thanks.

Liang

pgsql-general by date:

Previous
From: Adrian Klaver
Date:
Subject: Re: Re: How to know there is any ODBC Driver installed in the Linux redhat 5.7 server? Thanks
Next
From: Randy Johnson
Date:
Subject: Simultaneous Installations 7.4 9.x