Thread: Re: BUG #1347: Bulk Import stopps after a while ( 8.0.0.

Re: BUG #1347: Bulk Import stopps after a while ( 8.0.0.

From
Kris Jurka
Date:
I sent him a driver that was recompiled with MAX_BUFFERED_QUERIES = 1 and
he still appears to be having some problems, but I have no idea where.

Kris Jurka

---------- Forwarded message ----------
Date: Mon, 13 Dec 2004 06:51:10 -0800 (PST)
From: Bahadur Singh <bahadursingh@yahoo.com>
To: Kris Jurka <books@ejurka.com>
Subject: Re: [BUGS] BUG #1347: Bulk Import  stopps after a while ( 8.0.0.
    RC1)

Thanks for your efforts.
It works but not fully:

Batch Size == Result (with last compilation from
you..)

1000 == Works, a before quite fast..
2000 == Works,   -- do--
5000 == Works fine.. little slow (before it was not
working always..)

10,000 == Sometime worked (more slower.. before it was
not working .. )
20,000 == Did not worked ..

But, somehow I am convinced that this is JDBC driver
problem, so I can change this setting to optimal. I
was  worried as if would not have been DB server
problem.

Many Thanks for your help !

With Best Regards
Bahadur


Re: [JDBC] BUG #1347: Bulk Import stopps after a while (

From
Oliver Jowett
Date:
Kris Jurka wrote:
> I sent him a driver that was recompiled with MAX_BUFFERED_QUERIES = 1 and
> he still appears to be having some problems, but I have no idea where.

I wonder if he is doing one transaction per batch update loop or
something similar. If there's a bottleneck on the server side that's
related to the number of updates in a transaction (deferred constraints
or something similar?) then that could explain some of the behaviour.
Don't know why changing MAX_BUFFERED_QUERIES would change things at all
if that's the case, though.

-O