Thread: pg_restore from split files

pg_restore from split files

From
akp geek
Date:
Hi All -

    I have created a dump of a big table into 5 split files.  What is the procedure to restore them using pg_dump.

I am getting the following error

pg_restore: [custom archiver] could not read from input file: end of file
pg_restore: *** aborted because of error

Appreciate your help.

Regards

Re: pg_restore from split files

From
Igor Neyman
Date:

How exactly did you create “split” dump?

 

Igor Neyman

 

From: pgsql-general-owner@postgresql.org [mailto:pgsql-general-owner@postgresql.org] On Behalf Of akp geek
Sent: Monday, April 22, 2013 3:36 PM
To: pgsql-general
Subject: [GENERAL] pg_restore from split files

 

Hi All -

 

    I have created a dump of a big table into 5 split files.  What is the procedure to restore them using pg_dump.

 

I am getting the following error

 

pg_restore: [custom archiver] could not read from input file: end of file

pg_restore: *** aborted because of error

 

Appreciate your help.

 

Regards

Re: pg_restore from split files

From
akp geek
Date:
pg_dump dbname -n schemaname -t table_name -Fc | split -b 500m -t table.dump


On Mon, Apr 22, 2013 at 3:41 PM, Igor Neyman <ineyman@perceptron.com> wrote:

How exactly did you create “split” dump?

 

Igor Neyman

 

From: pgsql-general-owner@postgresql.org [mailto:pgsql-general-owner@postgresql.org] On Behalf Of akp geek
Sent: Monday, April 22, 2013 3:36 PM
To: pgsql-general
Subject: [GENERAL] pg_restore from split files

 

Hi All -

 

    I have created a dump of a big table into 5 split files.  What is the procedure to restore them using pg_dump.

 

I am getting the following error

 

pg_restore: [custom archiver] could not read from input file: end of file

pg_restore: *** aborted because of error

 

Appreciate your help.

 

Regards


Re: pg_restore from split files

From
Igor Neyman
Date:

I don’t think pg_restore is able to deal with your split files.

What was the reasoning for doing this?  Did you try first on smaller table/files to see if your dump/split/restore procedure would work?

 

Igor Neyman

 

 

From: akp geek [mailto:akpgeek@gmail.com]
Sent: Monday, April 22, 2013 3:47 PM
To: Igor Neyman
Cc: pgsql-general
Subject: Re: [GENERAL] pg_restore from split files

 

pg_dump dbname -n schemaname -t table_name -Fc | split -b 500m -t table.dump

 

On Mon, Apr 22, 2013 at 3:41 PM, Igor Neyman <ineyman@perceptron.com> wrote:

How exactly did you create “split” dump?

 

Igor Neyman

 

From: pgsql-general-owner@postgresql.org [mailto:pgsql-general-owner@postgresql.org] On Behalf Of akp geek
Sent: Monday, April 22, 2013 3:36 PM
To: pgsql-general
Subject: [GENERAL] pg_restore from split files

 

Hi All -

 

    I have created a dump of a big table into 5 split files.  What is the procedure to restore them using pg_dump.

 

I am getting the following error

 

pg_restore: [custom archiver] could not read from input file: end of file

pg_restore: *** aborted because of error

 

Appreciate your help.

 

Regards

 

Re: pg_restore from split files

From
Steven Schlansker
Date:
On Apr 22, 2013, at 12:47 PM, akp geek <akpgeek@gmail.com> wrote:

> pg_dump dbname -n schemaname -t table_name -Fc | split -b 500m -t table.dump

Since you split the files outside of the Postgres world, you have to combine them again.  Roughly,

cat table.dump.* > table.dump.combined
pg_restore --usual-arguments table.dump.combined


> On Mon, Apr 22, 2013 at 3:41 PM, Igor Neyman <ineyman@perceptron.com> wrote:
> How exactly did you create “split” dump?
>
>
>
> Igor Neyman
>
>
>
> From: pgsql-general-owner@postgresql.org [mailto:pgsql-general-owner@postgresql.org] On Behalf Of akp geek
> Sent: Monday, April 22, 2013 3:36 PM
> To: pgsql-general
> Subject: [GENERAL] pg_restore from split files
>
>
>
> Hi All -
>
>
>
>     I have created a dump of a big table into 5 split files.  What is the procedure to restore them using pg_dump.
>
>
>
> I am getting the following error
>
>
>
> pg_restore: [custom archiver] could not read from input file: end of file
>
> pg_restore: *** aborted because of error
>
>
>
> Appreciate your help.
>
>
>
> Regards
>
>



Re: pg_restore from split files

From
akp geek
Date:
It works ...  " combine them again.  "   Thank you all

Regards


On Mon, Apr 22, 2013 at 3:57 PM, Steven Schlansker <steven@likeness.com> wrote:

On Apr 22, 2013, at 12:47 PM, akp geek <akpgeek@gmail.com> wrote:

> pg_dump dbname -n schemaname -t table_name -Fc | split -b 500m -t table.dump

Since you split the files outside of the Postgres world, you have to combine them again.  Roughly,

cat table.dump.* > table.dump.combined
pg_restore --usual-arguments table.dump.combined


> On Mon, Apr 22, 2013 at 3:41 PM, Igor Neyman <ineyman@perceptron.com> wrote:
> How exactly did you create “split” dump?
>
>
>
> Igor Neyman
>
>
>
> From: pgsql-general-owner@postgresql.org [mailto:pgsql-general-owner@postgresql.org] On Behalf Of akp geek
> Sent: Monday, April 22, 2013 3:36 PM
> To: pgsql-general
> Subject: [GENERAL] pg_restore from split files
>
>
>
> Hi All -
>
>
>
>     I have created a dump of a big table into 5 split files.  What is the procedure to restore them using pg_dump.
>
>
>
> I am getting the following error
>
>
>
> pg_restore: [custom archiver] could not read from input file: end of file
>
> pg_restore: *** aborted because of error
>
>
>
> Appreciate your help.
>
>
>
> Regards
>
>