Re: File size consideration of file_fdw in PostgreSQL - Mailing list pgsql-general

From Albe Laurenz
Subject Re: File size consideration of file_fdw in PostgreSQL
Date
Msg-id A737B7A37273E048B164557ADEF4A58B17BB5A27@ntex2010a.host.magwien.gv.at
Whole thread Raw
In response to File size consideration of file_fdw in PostgreSQL  (Xiaobo Gu <guxiaobo1982@gmail.com>)
List pgsql-general
Xiaobo Gu wrote:
> We have very large files in size will be created as external tables in PostgreSQL via file_fdw, we
> have the following considerations:
> 1. Can file_fdw handle files with size large than the size of RAM in the server.

That shouldn't be a problem.

> 2. Will file_fdw scan the full file every time when the external table is queried, even we have
> "where" clause to narrow to a subset of rows , as the file_fdw doesn't have a server engine.

Yes, the complete file will be read whenever the foreign
table is queried.

Yours,
Laurenz Albe

pgsql-general by date:

Previous
From: Martin Durao
Date:
Subject: Get / Set Composite Type Fields within triggers
Next
From: Albe Laurenz
Date:
Subject: Re: WAL archiving not starting at the beginning