Re: slow insert speeds with bytea - Mailing list pgsql-general

From Steve Atkins
Subject Re: slow insert speeds with bytea
Date
Msg-id 821991dd-f917-8402-471a-2d7f974ac801@blighty.com
Whole thread Raw
In response to slow insert speeds with bytea  ("Alex O'Ree" <alexoree@apache.org>)
List pgsql-general
On 01/12/2019 17:59, Alex O'Ree wrote:
> Is there anything I can to increase insert speeds for bytea? Currently 
> running postgres 9.6.15
>
> I have a few tables without a bytea and a few with bytea. There is a 
> large performance difference with inserts between the two. I'm 
> inserting a byte[] that's usually less than 1MB on content. The 
> content itself is actually just utf8 string data.
>
> For the non-bytea table, inserts can be as high as 40k rows/sec, 
> whereas the bytea table is closer to 4k/sec or less.

4k 1MB rows/sec would be 4GB a second. It would need to be a fairly 
decent IO system to manage that speed, let alone ten times that.

What's the typical row size of the tables with bytea fields vs the other 
tables?

What are your IO stats during the two sorts of insert?

Cheers,
   Steve



pgsql-general by date:

Previous
From: Adrian Klaver
Date:
Subject: Re: slow insert speeds with bytea
Next
From: Antonio Silva
Date:
Subject: Re: using replace function