Re: Storing thousands of csv files in postgresql - Mailing list pgsql-sql

From Ion Alberdi
Subject Re: Storing thousands of csv files in postgresql
Date
Msg-id CANbgw4Akzgf5Nzd5k6oir-JOXEqH9tyNgi40ESaNRJ1ps_2KYw@mail.gmail.com
Whole thread Raw
In response to Re: Storing thousands of csv files in postgresql  (Marcos Pegoraro <marcos@f10.com.br>)
List pgsql-sql
Hi Marcos, 

>All those thousands of CSV files have a completely unknown structure ?
Exactly

Le mar. 15 févr. 2022 à 21:28, Marcos Pegoraro <marcos@f10.com.br> a écrit :
I'm going to challenge that the question is not one for Postgres, but you should be asking "What filesystem is best suited to having many files in the same directory" and let the technology deal with the problem.  Postgres is just dependent on the filesystem for this behavior.  And to that answer, I believe, is XFS.  

He didn't say how many different schemas will have.
All those thousands of CSV files have a completely unknown structure ?
Or you'll have just dozens or hundreds of structures ?

Marcos

pgsql-sql by date:

Previous
From: Erik Brandsberg
Date:
Subject: Re: Storing thousands of csv files in postgresql
Next
From: Steve Midgley
Date:
Subject: Re: Storing thousands of csv files in postgresql