Re: Speed up COPY TO text/CSV parsing using SIMD - Mailing list pgsql-hackers

From Andres Freund
Subject Re: Speed up COPY TO text/CSV parsing using SIMD
Date
Msg-id aY5C6Xa5im72NF_Y@alap3.anarazel.de
Whole thread Raw
In response to Speed up COPY TO text/CSV parsing using SIMD  (KAZAR Ayoub <ma_kazar@esi.dz>)
Responses Re: Speed up COPY TO text/CSV parsing using SIMD
List pgsql-hackers
Hi,

On 2026-02-12 22:07:52 +0100, KAZAR Ayoub wrote:
> Currently optimizing COPY FROM using SIMD is still under review, but for
> the case of COPY TO using the same ideas, we found that the problem is
> trivial, the attached patch gives very nice speedups as confirmed by
> Manni's benchmarks.

I have a hard time believing that adding a strlen() to the handling of a short
column won't be a measurable overhead with lots of short attributes.
Particularly because the patch afaict will call it repeatedly if there are any
to-be-escaped characters.

I also don't think it's good how much code this repeats. I think you'd have to
start with preparatory moving the exiting code into static inline helper
functions and then introduce SIMD into those.

Greetings,

Andres Freund



pgsql-hackers by date:

Previous
From: Nathan Bossart
Date:
Subject: Re: [PATCH] Support reading large objects with pg_read_all_data
Next
From: Andres Freund
Date:
Subject: Re: pg_upgrade: transfer pg_largeobject_metadata's files when possible