Thread: Foreign Data Wrappers

Foreign Data Wrappers

From
Gus Spier
Date:
I find myself in new territory, Foreign Data Wrappers (FDW). I stumble closer to success through the documentation, youtube videos, and various google resources. But I've come across a concept that intrigues me very deeply.

If I understand the concepts correctly, FDW not only makes other databases available, FDW also offers access to .csv files, plain text, or just about anything that can be bullied into some kind of query-able order. Has anyone ever tried to connect to redis or elasticache? If so, how did it work out? 

Regards,
Gus



--
Gus

540-454-3074

“Characteropathic individuals adopt ideologies created by doctrinaire, often schizoidal people, recast them into an active propaganda form, and disseminate it with their characteristic pathological egotism and paranoid intolerance for any philosophies which may differ from their own.” (Political Ponerology, Andrew Lobaczewski, 1984)

Re: Foreign Data Wrappers

From
Christophe Pettus
Date:

> On Sep 6, 2024, at 17:55, Gus Spier <gus.spier@gmail.com> wrote:
> If I understand the concepts correctly, FDW not only makes other databases available, FDW also offers access to .csv
files,plain text, or just about anything that can be bullied into some kind of query-able order. 

There two parts to FDWs: The code in the PostgreSQL core, and the FDW extension that is specific to type of the remote
datasource.  It's up to the plug-in to translate the remote data source into a format that appears as a foreign table,
sothe specifics of how the remote data source are mapped to the table depend on the plug-ins implementation.  You need
toinstall the FDW extension in the PostgreSQL instance as you do with any extension.  There are a lot of different
plug-ins,of varying degrees to maintenance, out in the ecosystem.  They definitely exist for Redis; I'm not sure about
Elasticache.


Re: Foreign Data Wrappers

From
Ian Lawrence Barwick
Date:
2024年9月7日(土) 9:55 Gus Spier <gus.spier@gmail.com>:
>
> I find myself in new territory, Foreign Data Wrappers (FDW). I stumble closer to success through the documentation,
youtubevideos, and various google resources. But I've come across a concept that intrigues me very deeply. 
>
> If I understand the concepts correctly, FDW not only makes other databases available, FDW also offers access to .csv
files,plain text, or just about anything that can be bullied into some kind of query-able order. Has anyone ever tried
toconnect to redis or elasticache? If so, how did it work out? 

There are two FDW implementations listed for Redis here:

    https://wiki.postgresql.org/wiki/Foreign_data_wrappers#NoSQL_Database_Wrappers

but neither have been updated for recent PostgreSQL versions.

Regards

Ian Barwick



Re: Foreign Data Wrappers

From
Tom Lane
Date:
Gus Spier <gus.spier@gmail.com> writes:
> If I understand the concepts correctly, FDW not only makes other databases
> available, FDW also offers access to .csv files, plain text, or just about
> anything that can be bullied into some kind of query-able order. Has anyone
> ever tried to connect to redis or elasticache? If so, how did it work out?

Looks like it's been done:

https://wiki.postgresql.org/wiki/Foreign_data_wrappers

(No warranty expressed or implied on the quality of these
particular FDWs.)

            regards, tom lane



Re: Foreign Data Wrappers

From
Gus Spier
Date:
Thanks for the pointers!

I'll resume my task in the morning. If I get anywhere, I will post the outcome.

R,
Gus

On Fri, Sep 6, 2024 at 9:35 PM Tom Lane <tgl@sss.pgh.pa.us> wrote:
Gus Spier <gus.spier@gmail.com> writes:
> If I understand the concepts correctly, FDW not only makes other databases
> available, FDW also offers access to .csv files, plain text, or just about
> anything that can be bullied into some kind of query-able order. Has anyone
> ever tried to connect to redis or elasticache? If so, how did it work out?

Looks like it's been done:

https://wiki.postgresql.org/wiki/Foreign_data_wrappers

(No warranty expressed or implied on the quality of these
particular FDWs.)

                        regards, tom lane

Re: Foreign Data Wrappers

From
Brent Wood
Date:
The most interesting (IMHO) FDW implementation I have used is an Australian WFS service mounted locally as a Postgis table.

Not wonderful performance, but full spatial query functionality.

If performance was an issue, "create table as select * from FDW;" creates a local cache...

Very useful functionality.


Brent Wood

On Saturday, September 7, 2024 at 12:55:37 PM GMT+12, Gus Spier <gus.spier@gmail.com> wrote:


I find myself in new territory, Foreign Data Wrappers (FDW). I stumble closer to success through the documentation, youtube videos, and various google resources. But I've come across a concept that intrigues me very deeply.

If I understand the concepts correctly, FDW not only makes other databases available, FDW also offers access to .csv files, plain text, or just about anything that can be bullied into some kind of query-able order. Has anyone ever tried to connect to redis or elasticache? If so, how did it work out? 

Regards,
Gus



--
Gus

540-454-3074

“Characteropathic individuals adopt ideologies created by doctrinaire, often schizoidal people, recast them into an active propaganda form, and disseminate it with their characteristic pathological egotism and paranoid intolerance for any philosophies which may differ from their own.” (Political Ponerology, Andrew Lobaczewski, 1984)