Re: slow insert speeds with bytea - Mailing list pgsql-general

From Jeff Janes
Subject Re: slow insert speeds with bytea
Date
Msg-id CAMkU=1zvDu2E-OFyJF1oYCNV3ayEBgZsgrNQAhrR8yyo7D0FGA@mail.gmail.com
Whole thread Raw
In response to slow insert speeds with bytea  ("Alex O'Ree" <alexoree@apache.org>)
List pgsql-general
On Mon, Dec 2, 2019 at 4:42 AM Alex O'Ree <alexoree@apache.org> wrote:
Is there anything I can to increase insert speeds for bytea? Currently running postgres 9.6.15

I have a few tables without a bytea and a few with bytea. There is a large performance difference with inserts between the two. I'm inserting a byte[] that's usually less than 1MB on content. The content itself is actually just utf8 string data.

For the non-bytea table, inserts can be as high as 40k rows/sec, whereas the bytea table is closer to 4k/sec or less.

If this is just a limitation of postgres, then that's fine but the performance delta is so significant that i feel like i'm missing something

That does seem pretty drastic.  But I don't think we will get anywhere unless you post your actual benchmarking program so that we can try it for ourselves.  I certainly don't see anything that drastic in my own testing.  Maybe the bottleneck is on the client side.

Cheers,

Jeff

pgsql-general by date:

Previous
From: Alexander Farber
Date:
Subject: Re: Syntax error for UPDATE ... RETURNING INTO STRICT
Next
From: Tom Lane
Date:
Subject: Re: Syntax error for UPDATE ... RETURNING INTO STRICT