Thread: [GENERAL] Postgresql CDC tool recommendations ?

[GENERAL] Postgresql CDC tool recommendations ?

From
avi Singh
Date:
Guys
         Any recommendation on a good CDC tool that can be used to push postgresql changes to Kafka in json format ?

Thanks
Avi

Re: [GENERAL] Postgresql CDC tool recommendations ?

From
Steve Atkins
Date:
> On Oct 5, 2017, at 10:28 AM, avi Singh <avisingh19811981@gmail.com> wrote:
>
> Guys
>          Any recommendation on a good CDC tool that can be used to push postgresql changes to Kafka in json format ?

Not sure whether json is a constraint, but I'd look at http://debezium.io  and (maybe) the no longer supported
https://github.com/confluentinc/bottledwater-pg

Cheers, Steve

--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Postgresql CDC tool recommendations ?

From
Nico Williams
Date:
On Thu, Oct 05, 2017 at 10:28:31AM -0700, avi Singh wrote:
>          Any recommendation on a good CDC tool that can be used to push
> postgresql changes to Kafka in json format ?

There are quite a few WAL->JSON type tools out there.  E.g.,
https://github.com/eulerto/wal2json

I expect this to improve with PG 10 logical replication.

You can easily add the bit that pushes those JSON texts to Kafka.

Nico
-- 


-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general