Thread: Table copy

On 2/4/25 11:51 AM, Andy Hartman wrote:
> I'm copying a large table from mssql to PG using SImplysql and in the 
> Log I see this message
> 
> 2025-02-04 14:42:17.975 EST [4796] ERROR:  unexpected EOF on client 
> connection with an open transaction

The above pretty much spells it out.

Something messed with the connection from the client.

You need to look at Postgres and system logs to see if you can track 
down what?

FYI, more information would be helpful:

1) MS SQL version.

2) Postgres version.

3) SimplySQL version.

4) The complete copy command.

5) The amount of data being transferred.

6) The OS'es and their versions on both ends.


> 2025-02-04 14:42:17.975 EST [4796] CONTEXT:  COPY sqlt_data_1_2022_03, 
> line 208274199, column tagid
> 2025-02-04 14:42:17.975 EST [4796] STATEMENT:  COPY sqlt_data_1_2022_03 
> (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity, 
> t_stamp) FROM STDIN (FORMAT BINARY)
> 2025-02-04 14:42:18.158 EST [4796] FATAL:  terminating connection 
> because protocol synchronization was lost
> 2025-02-04 14:42:18.265 EST [4796] LOG:  could not send data to client: 
> An established connection was aborted by the software in your host machine.
> it then dies with a data stream error.I have copied other tables on this 
> size with no problems.
> 
>   THanks.
> 
> 

-- 
Adrian Klaver
adrian.klaver@aklaver.com

On 2/5/25 9:46 AM, Andy Hartman wrote:
> [6992] ERROR:  unexpected EOF on client connection with an open transaction
> 2025-02-05 12:19:44.919 EST [6992] CONTEXT:  COPY sqlt_data_1_2022_03, 
> line 24431524, column dataintegrity
> 2025-02-05 12:19:44.919 EST [6992] STATEMENT:  COPY sqlt_data_1_2022_03 
> (tagid, intvalue, floatvalue, stringvalue, datevalue, dataintegrity, 
> t_stamp) FROM STDIN (FORMAT BINARY)
> 2025-02-05 12:19:44.919 EST [6992] FATAL:  terminating connection 
> because protocol synchronization was lost

You need to look at the other end of the connection also, in other words 
what is happening on the MS SQL Server 2016/Windows Server 2019 side?

Also is there anti-virus software running on either end?



-- 
Adrian Klaver
adrian.klaver@aklaver.com

On 2/5/25 13:05, Andy Hartman wrote:
> nothing in log from mssql side and no  anti-virus

How about the Windows Server 2019 system log?



-- 
Adrian Klaver
adrian.klaver@aklaver.com

On 2/5/25 13:09, Andy Hartman wrote:
> I also reduced batch size to 5000 on the last run  .. I like using this 
> SImplySql because it's a script I can launch, so that's why I chose that 
> solution...  I'm using it to load a History Env.

You really need to complete your thoughts, remember we have no idea what 
you are seeing unless you tell us.

Reducing the batch size did what?


> 
> THanks again.
> 

-- 
Adrian Klaver
adrian.klaver@aklaver.com

On 2/5/25 14:58, Andy Hartman wrote:
> Reduce batch size still caused error as reported nothing in WIndows 
> Server log...
> 
>   The SimplySql is slick because just qry from src and load to dst ... 
> Is there any way to somehow show more of the error in PS i tried the 
> $error but nothing very descriptive

Slick, except for the part where it is not working.

I have no idea what is going on at this point.

Some questions:

1) I don't know where the below is coming from?:

2025-02-04 14:42:18.265 EST [4796] LOG:  could not send data to client: 
An established connection was aborted by the software in your host machine.

I have searched the Postgres and SimpleSql source and I cannot find it 
in either.

Is the error message straight from the log or was it translated?

Where did you install Postgres from?

2) What are the exact versions for SimpleSql and the MS SQL Server and 
Postgres drivers you are using?

3) What is the network setup between the source and destination databases?

4) What if you move an overall smaller quantity of data over?




> 
> On Wed, Feb 5, 2025 at 4:23 PM Adrian Klaver <adrian.klaver@aklaver.com 
> <mailto:adrian.klaver@aklaver.com>> wrote:
> 
>     On 2/5/25 13:09, Andy Hartman wrote:
>      > I also reduced batch size to 5000 on the last run  .. I like
>     using this
>      > SImplySql because it's a script I can launch, so that's why I
>     chose that
>      > solution...  I'm using it to load a History Env.
> 
>     You really need to complete your thoughts, remember we have no idea
>     what
>     you are seeing unless you tell us.
> 
>     Reducing the batch size did what?
> 
> 
>      >
>      > THanks again.
>      >
> 
>     -- 
>     Adrian Klaver
>     adrian.klaver@aklaver.com <mailto:adrian.klaver@aklaver.com>
> 

-- 
Adrian Klaver
adrian.klaver@aklaver.com