Re: slow speeds after 2 million rows inserted - Mailing list pgsql-general

From Joshua D. Drake
Subject Re: slow speeds after 2 million rows inserted
Date
Msg-id 1167415855.21290.4.camel@localhost.localdomain
Whole thread Raw
In response to Re: slow speeds after 2 million rows inserted  (Rodrigo Gonzalez <rjgonzale@gmail.com>)
Responses Re: slow speeds after 2 million rows inserted
List pgsql-general
> > there is also an index on batchid.
> >
> > The insert command is like so:
> >
> > "INSERT INTO data_archive (batchid, claimid, memberid, raw_data, status,
> > line_number) VALUES ('" + commandBatchID + "', '', '', '" + raw_data +
> > "', '1', '" + myFilter.claimLine + "');";


Also as you are running 8.2 you can use multi valued inserts...

INSERT INTO data_archive values () () ()

> >
> > where the raw_data variable is the line from the file.
> >
> > How can I find out what is causing this slow down and how do I speed it up?
> >
> > Database is 8.2.0 on x86_64-unknown-linux-gnu.
> >
> > There is nothing else running on this database server (other than
> > standard linux background programs).  PS ax did not show anything else
> > running.  No locks other than the occasional lock by the INSERT query.
> > I have done a FULL vacuum on this table but not reindex (running now).
> >
> > Thanks in advance,
> > James
> >
> > ---------------------------(end of broadcast)---------------------------
> > TIP 2: Don't 'kill -9' the postmaster
> >
>
> Consider using copy
>
> ---------------------------(end of broadcast)---------------------------
> TIP 9: In versions below 8.0, the planner will ignore your desire to
>        choose an index scan if your joining column's datatypes do not
>        match
>
--

      === The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
Providing the most comprehensive  PostgreSQL solutions since 1997
             http://www.commandprompt.com/

Donate to the PostgreSQL Project: http://www.postgresql.org/about/donate




pgsql-general by date:

Previous
From: Ragnar
Date:
Subject: Re: could not open relation:no such file or directory
Next
From: James Neff
Date:
Subject: Re: slow speeds after 2 million rows inserted