Thread: How to opimize the insertion of data

How to opimize the insertion of data

From
Juan Francisco Diaz
Date:
Hi,  have tried by all means to optimize the insertion of data in my db but
it has been impossible.
Righto now to insert around 300 thou records it takes soemthing like 50 to
65 minutes (too  long).
Im using a Mac powerpc g4 533Mhz with 256 RAM.
I would relly appreciate that the insertion process is done in like 30 or 35
minutes TOPS. So far it is impossible.
My db right now has no FK, no indexes, the insertions is being done in batch
(19 thou records).
Is it possible with my current machine to achieve the level of performance
i've metioned?
Any help would be greatly appreciated, by the way the same insertion takes
25 mins in ms sqlserver2000 in a p3 1.4ghz 1gig ram.
Thanks

JuanF


Re: How to opimize the insertion of data

From
Alberto Caso
Date:
On Tue, 09-09-2003 at 23:05, Juan Francisco Diaz wrote:
> Hi,  have tried by all means to optimize the insertion of data in my db but
> it has been impossible.
> Righto now to insert around 300 thou records it takes soemthing like 50 to
> 65 minutes (too  long).

    Try enclosing your inserts into transactions of several thousands of
inserts, i.e:


    begin;
    (several thousands of inserts)
    commit;
    ...


    You may also want to have a look at the COPY command:

    http://developer.postgresql.org/docs/postgres/sql-copy.html

    Have also a look at:

    http://www.postgresql.org/docs/7.3/interactive/populate.html

    Best regards,

--
Alberto Caso Palomino
Adaptia Soluciones Integrales
http://www.adaptia.net
alberto.caso@adaptia.net



Attachment