Thread: bulk data loading

Hi all,<br /><br /> I need to do a bulk data loading around 704GB (log file size) at present  in 8 hrs (1 am - 9am).
Thedata file size may increase 3 to 5 times in future.<br /><br /> Using COPY it takes 96 hrs to finish the task.<br />
Whatis the best way to do it ?<br /><br /> HARDWARE: SUN THUMPER/ RAID10<br /> OS : SOLARIS 10.<br /> DB:
Greenplum/Postgres<br/><br /><br /> Regards, <br /> Srikanth k Potluri <br /> +63 9177444783(philippines) <br /><br
/><spanstyle="font-weight: bold;"><br /></span><blockquote style="border-left: 2px solid rgb(245, 245, 245);
margin-left:5px; margin-right: 0px; padding-left: 5px; padding-right: 0px;"><br /></blockquote><br /> 

Potluri  Srikanth wrote:
> Hi all,
>
> I need to do a bulk data loading around 704GB (log file size) at
> present  in 8 hrs (1 am - 9am). The data file size may increase 3 to
> 5 times in future.
>
> Using COPY it takes 96 hrs to finish the task.
> What is the best way to do it ?
>
> HARDWARE: SUN THUMPER/ RAID10
> OS : SOLARIS 10.
> DB: Greenplum/Postgres

If you're using Greenplum, you should probably be talking to the
Greenplum folks. IIRC, they have made some fairly large changes to the
load process, so they'll be the ones with the proper answers for you.

//Magnus