Postgres Pro
Downloads
Home   >   mailing lists

Re: Online DW - Mailing list pgsql-hackers

From Sridhar N Bamandlapally
Subject Re: Online DW
Date
Msg-id CAGuFTBUeEvn6TeTu7J8V+BF0_+qJYg6uFZT4Pej+sdLf9kubfg@mail.gmail.com
Whole thread Raw
In response to Re: Online DW  (Craig Ringer <craig@2ndquadrant.com>)
List pgsql-hackers
Tree view
One thing looks possible ( feature not available), just an idea

example/syntax:

BEGIN NOARCHIVE;

  --- transaction-1 
  --- transaction-2 
  .
  .
  --- transaction-N 

END;

This/These will be performed in Production to clean-up archive which will not be sync with Archive/DW DB only

one heads-up is Archive/DW DB may need to build WITHOUT CONSTRAINTS

May need to introduce ARCHIVE system/tag in pg_hba.conf

Thanks
Sridhar
OpenText














On Fri, Jun 10, 2016 at 2:22 PM, Craig Ringer <craig@2ndquadrant.com> wrote:
On 10 June 2016 at 16:11, Sridhar N Bamandlapally <sridhar.bn1@gmail.com> wrote:
Hi

Is there any feature in PostgreSQL where online DW (Dataware housing) is possible ?

am looking for scenario like

1. Production DB will have CURRENT + LAST 7 DAYS data only

2. Archive/DW DB will have CURRENT + COMPLETE HISTORY

expecting something like streaming, but not ETL

There's nothing built-in, but that's exactly the sort of thing pglogical is intended for. You can also build something along those lines with Londiste fairly easily.

Hopefully this is the sort of thing we can move toward with built-in logical replication in coming releases.

--
 Craig Ringer                   http://www.2ndQuadrant.com/
 PostgreSQL Development, 24x7 Support, Training & Services

pgsql-hackers by date:

Previous
From: Amit Langote
Date:
Subject: Re: [sqlsmith] Failed assertion in postgres_fdw/deparse.c:1116
Next
From: Andreas Karlsson
Date:
Subject: Re: Parallel safety tagging of extension functions