Thread: file_fdw vs relative paths
According to the documentation, the filename given in file_fdw must be an absolute path. Hwever, it works perfectly fine with a relative path.
So either the documentation is wrong, or the code is wrong. It behaves the same at least back to 9.5, I did not try it further back than that.
I can't find a reference to the code that limits this. AFAICT the documentation has been there since day 1.
Question is, which one is right. Is there a reason we'd want to restrict it to absolute pathnames?
On Wed, Jul 15, 2020 at 01:22:21PM +0200, Magnus Hagander wrote:
> According to the documentation, the filename given in file_fdw must be an
> absolute path. Hwever, it works perfectly fine with a relative path.
>
> So either the documentation is wrong, or the code is wrong. It behaves the same
> at least back to 9.5, I did not try it further back than that.
Yes, I tested back to 9.5 too:
CREATE EXTENSION file_fdw;
CREATE SERVER pgconf FOREIGN DATA WRAPPER file_fdw;
CREATE FOREIGN TABLE pgconf (line TEXT) SERVER pgconf OPTIONS ( filename
'postgresql.conf', format 'text', delimiter E'\x7f' );
SELECT * FROM pgconf;
# -----------------------------
# PostgreSQL configuration file
# -----------------------------
#
# This file consists of lines of the form:
...
> I can't find a reference to the code that limits this. AFAICT the documentation
> has been there since day 1.
>
> Question is, which one is right. Is there a reason we'd want to restrict it to
> absolute pathnames?
I think it should work just like COPY, which allows relative paths; doc
patch attached.
--
Bruce Momjian <bruce@momjian.us> https://momjian.us
EnterpriseDB https://enterprisedb.com
The usefulness of a cup is in its emptiness, Bruce Lee
Attachment
On Aug 25, 2020, at 8:26 AM, Bruce Momjian <bruce@momjian.us> wrote:Yes, I tested back to 9.5 too:
CREATE EXTENSION file_fdw;
CREATE SERVER pgconf FOREIGN DATA WRAPPER file_fdw;
CREATE FOREIGN TABLE pgconf (line TEXT) SERVER pgconf OPTIONS ( filename
'postgresql.conf', format 'text', delimiter E'\x7f' );
SELECT * FROM pgconf;
# -----------------------------
# PostgreSQL configuration file
# -----------------------------
#
# This file consists of lines of the form:
…
The file_fdw extension was introduced by commit 7c5d0ae7078456bfeedb2103c45b9a32285c2631,
and I tested it supports relative paths. This is a doc bug.
--
Japin Li
On Tue, Aug 25, 2020 at 9:28 AM Li Japin <japinli@hotmail.com> wrote:
On Aug 25, 2020, at 8:26 AM, Bruce Momjian <bruce@momjian.us> wrote:Yes, I tested back to 9.5 too:
CREATE EXTENSION file_fdw;
CREATE SERVER pgconf FOREIGN DATA WRAPPER file_fdw;
CREATE FOREIGN TABLE pgconf (line TEXT) SERVER pgconf OPTIONS ( filename
'postgresql.conf', format 'text', delimiter E'\x7f' );
SELECT * FROM pgconf;
# -----------------------------
# PostgreSQL configuration file
# -----------------------------
#
# This file consists of lines of the form:
…The file_fdw extension was introduced by commit 7c5d0ae7078456bfeedb2103c45b9a32285c2631,and I tested it supports relative paths. This is a doc bug.
Well technically it can also have been a code bug but yes if so it is one that has lived since day 1. But given that nobody has chimed in to say they think that's what it is for a month, I think we'll conclude it's a docs bug.
Bruce, I've applied and backpatched your docs patch for this.
On Mon, Aug 31, 2020 at 1:10 PM Magnus Hagander <magnus@hagander.net> wrote:
On Tue, Aug 25, 2020 at 9:28 AM Li Japin <japinli@hotmail.com> wrote:On Aug 25, 2020, at 8:26 AM, Bruce Momjian <bruce@momjian.us> wrote:Yes, I tested back to 9.5 too:
CREATE EXTENSION file_fdw;
CREATE SERVER pgconf FOREIGN DATA WRAPPER file_fdw;
CREATE FOREIGN TABLE pgconf (line TEXT) SERVER pgconf OPTIONS ( filename
'postgresql.conf', format 'text', delimiter E'\x7f' );
SELECT * FROM pgconf;
# -----------------------------
# PostgreSQL configuration file
# -----------------------------
#
# This file consists of lines of the form:
…The file_fdw extension was introduced by commit 7c5d0ae7078456bfeedb2103c45b9a32285c2631,and I tested it supports relative paths. This is a doc bug.Well technically it can also have been a code bug but yes if so it is one that has lived since day 1. But given that nobody has chimed in to say they think that's what it is for a month, I think we'll conclude it's a docs bug.Bruce, I've applied and backpatched your docs patch for this.
Gah, and of course right after doing that, I remembered I wanted to get a second change in :) To solve the "who's this Josh" question, I suggest we also change the example to point to the data/log directory which is likely to exist in a lot more of the cases. I keep getting people who ask "who is josh" based on the /home/josh path. Not that it's that important, but...
Attachment
On Mon, Aug 31, 2020 at 01:16:05PM +0200, Magnus Hagander wrote: > Bruce, I've applied and backpatched your docs patch for this. > > Gah, and of course right after doing that, I remembered I wanted to get a > second change in :) To solve the "who's this Josh" question, I suggest we also > change the example to point to the data/log directory which is likely to exist > in a lot more of the cases. I keep getting people who ask "who is josh" based > on the /home/josh path. Not that it's that important, but... Thanks, and agreed. -- Bruce Momjian <bruce@momjian.us> https://momjian.us EnterpriseDB https://enterprisedb.com The usefulness of a cup is in its emptiness, Bruce Lee
On Mon, Aug 31, 2020 at 5:03 PM Bruce Momjian <bruce@momjian.us> wrote:
On Mon, Aug 31, 2020 at 01:16:05PM +0200, Magnus Hagander wrote:
> Bruce, I've applied and backpatched your docs patch for this.
>
> Gah, and of course right after doing that, I remembered I wanted to get a
> second change in :) To solve the "who's this Josh" question, I suggest we also
> change the example to point to the data/log directory which is likely to exist
> in a lot more of the cases. I keep getting people who ask "who is josh" based
> on the /home/josh path. Not that it's that important, but...
Thanks, and agreed.
Thanks, applied. I backpacked to 13 but didn't bother with the rest as it's not technically *wrong* before..
//Magnus
Hi
On 2020/09/07 2:31, Magnus Hagander wrote:
> On Mon, Aug 31, 2020 at 5:03 PM Bruce Momjian <bruce@momjian.us <mailto:bruce@momjian.us>> wrote:
>
> On Mon, Aug 31, 2020 at 01:16:05PM +0200, Magnus Hagander wrote:
> > Bruce, I've applied and backpatched your docs patch for this.
> >
> > Gah, and of course right after doing that, I remembered I wanted to get a
> > second change in :) To solve the "who's this Josh" question, I suggest we also
> > change the example to point to the data/log directory which is likely to exist
> > in a lot more of the cases. I keep getting people who ask "who is josh" based
> > on the /home/josh path. Not that it's that important, but...
>
> Thanks, and agreed.
>
>
> Thanks, applied. I backpacked to 13 but didn't bother with the rest as it's not technically *wrong* before..
It's missing the leading single quote from the filename parameter:
diff --git a/doc/src/sgml/file-fdw.sgml b/doc/src/sgml/file-fdw.sgml
(...)
-OPTIONS ( filename '/home/josh/data/log/pglog.csv', format 'csv' );
+OPTIONS ( filename log/pglog.csv', format 'csv' );
(...)
Regards
Ian Barwick
--
Ian Barwick https://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Training & Services
On Wed, Sep 9, 2020 at 3:39 AM Ian Barwick <ian.barwick@2ndquadrant.com> wrote:
Hi
On 2020/09/07 2:31, Magnus Hagander wrote:
> On Mon, Aug 31, 2020 at 5:03 PM Bruce Momjian <bruce@momjian.us <mailto:bruce@momjian.us>> wrote:
>
> On Mon, Aug 31, 2020 at 01:16:05PM +0200, Magnus Hagander wrote:
> > Bruce, I've applied and backpatched your docs patch for this.
> >
> > Gah, and of course right after doing that, I remembered I wanted to get a
> > second change in :) To solve the "who's this Josh" question, I suggest we also
> > change the example to point to the data/log directory which is likely to exist
> > in a lot more of the cases. I keep getting people who ask "who is josh" based
> > on the /home/josh path. Not that it's that important, but...
>
> Thanks, and agreed.
>
>
> Thanks, applied. I backpacked to 13 but didn't bother with the rest as it's not technically *wrong* before..
It's missing the leading single quote from the filename parameter:
diff --git a/doc/src/sgml/file-fdw.sgml b/doc/src/sgml/file-fdw.sgml
(...)
-OPTIONS ( filename '/home/josh/data/log/pglog.csv', format 'csv' );
+OPTIONS ( filename log/pglog.csv', format 'csv' );
(...)
GAH.
Thanks!