RE: text fields and performance for ETL - Mailing list pgsql-docs

From Grega Jesih
Subject RE: text fields and performance for ETL
Date
Msg-id 516dc58b80fa418091f5262879019213@actual-it.si
Whole thread Raw
In response to Re: text fields and performance for ETL  ("David G. Johnston" <david.g.johnston@gmail.com>)
Responses Re: text fields and performance for ETL  (Laurenz Albe <laurenz.albe@cybertec.at>)
List pgsql-docs

Hi David.

 

> We’re entitled to a bit of self-centeredness here, especially when the broader world is so varied

One can tell ;-)

Current text:




Suggested current text addendum:

But, if you consider doing ETL from Postgres database to some outer target environment and you seek performance in such interfaces, follow the logic of limited size (varchar or char) data types in your database model. Because if you make a dataflow of known size types, interface code can take a big block of data while for text fields you need to check each record.

 

Optional additional remark:

Another good aspect of known data sizes is easier understanding of field content and implicit data (length) control.

 

 

Best regards
Grega

 

From: David G. Johnston <david.g.johnston@gmail.com>
Sent: Thursday, November 4, 2021 2:51 PM
To: Grega Jesih <Grega.Jesih@actual-it.si>
Cc: Tom Lane <tgl@sss.pgh.pa.us>; Pg Docs <pgsql-docs@lists.postgresql.org>
Subject: Re: text fields and performance for ETL

 

On Thursday, November 4, 2021, Grega Jesih <Grega.Jesih@actual-it.si> wrote:

 

So why would it then be published ? Because inexperienced programmers take your statement that "it's the same performance" from a wrong perspective, so it would be fair to note, that the remark "it's the same performance" is meant "within any operation inside Postgres database". In the moment we want to take this data elsewhere,

the problematic lack of model design comes out. 

If you wish to supply an actual patch for consideration I’d review it.  Absent that the documentation serves the vast majority of readers well as-is.  We’re entitled to a bit of self-centeredness here, especially when the broader world is so varied.

 

David J.

 


NOTICE - NOT TO BE REMOVED.
This e-mail and any attachments are confidential and may contain legally privileged information and/or copyright material of Actual I.T. or third parties. If you are not an authorised recipient of this e-mail, please contact Actual I.T. immediately by return email or by telephone or facsimile on the above numbers.
You should not read, print, re-transmit, store or act in reliance on this email or any attachments and you should destroy all copies of them.
Attachment

pgsql-docs by date:

Previous
From: "David G. Johnston"
Date:
Subject: Re: text fields and performance for ETL
Next
From: Laurenz Albe
Date:
Subject: Re: text fields and performance for ETL