Re: A more general approach (Re: Data archiving/warehousing idea) - Mailing list pgsql-hackers

From Ron Mayer
Subject Re: A more general approach (Re: Data archiving/warehousing idea)
Date
Msg-id 45C2396F.7090405@cheapcomplexdevices.com
Whole thread Raw
In response to A more general approach (Re: Data archiving/warehousing idea)  (Hannu Krosing <hannu@skype.net>)
List pgsql-hackers
Hannu Krosing wrote:
> ...is storing all tuple visibility info in a separate file.
> 
> At first it seems to just add overhead, but for lots (most ? ) usecases
> the separately stored visibility should be highly compressible, so for
> example for bulk-loaded tables you could end up with one bit per page
> saying that all tuples on this page are visible.

Seems you could do "one bit per page" compression even with
visibility data stored in the pages themselves.

I could imagine a table re-writing "vacuum freeze" that finds
pages with all data visible to everyone and packs them with
a single bit saying "everything here's frozen".

The penalty would be an expensive splitting of the page (and
who knows what evil locks would be needed) if an update is
ever done on those wholly frozen pages -- but we're talking
about read-mostly tables here so that tradeoff might not be bad.


pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: max_locks_per_transactions ...
Next
From: Bruce Momjian
Date:
Subject: Re: pg_restore fails with a custom backup file