Re: Data Warehousing - Mailing list pgsql-general

From Scott Marlowe
Subject Re: Data Warehousing
Date
Msg-id dcc563d10709030052w16d02d8esce2be0adfd129388@mail.gmail.com
Whole thread Raw
In response to Data Warehousing  ("Rob Kirkbride" <rob.kirkbride@gmail.com>)
Responses Re: Data Warehousing  ("Rob Kirkbride" <rob.kirkbride@gmail.com>)
List pgsql-general
On 9/3/07, Rob Kirkbride <rob.kirkbride@gmail.com> wrote:
> Hi,
>
> I've got a postgres database collected logged data. This data I have to keep
> for at least 3 years. The data in the first instance is being recorded in a
> postgres cluster. This then needs to be moved a reports database server for
> analysis. Therefore I'd like a job to dump data on the cluster say every
> hour and record this is in the reports database. The clustered database
> could be purged of say data more than a week old.
>
> So basically I need a dump/restore that only appends new data to the reports
> server database.
>
> I've googled but can't find anything, can anyone help?

You might find an answer in partitioning your data.  There's a section
in the docs on it.  Then you can just dump the old data from the
newest couple of partitions if you're partitioning by week, and dump
anything older with a simple delete where date < now() - interval '1
week' or something like that.

pgsql-general by date:

Previous
From: "Rob Kirkbride"
Date:
Subject: Data Warehousing
Next
From: "Andrej Ricnik-Bay"
Date:
Subject: Re: Data Warehousing