Skype presents: SkyTools 2.1 - queueing, replication and more... - Mailing list pgsql-announce

From Marko Kreen
Subject Skype presents: SkyTools 2.1 - queueing, replication and more...
Date
Msg-id 54331.194.126.108.9.1173801182.squirrel@mail.skype.net
Whole thread Raw
List pgsql-announce
This is a package of tools used in Skype for replication and
failover.  Also it includes a generic queuing mechanism PgQ and
utility library for Python scripts.

        https://developer.skype.com/SkypeGarage/DbProjects/SkyTools

Main components are:

PgQ
---

This is the queue machanism we use.  Consists of PL/pgsql, PL/python
and C code in database, with Python framework on top of it.  It is
based on snapshot based event handling ideas from Slony-I,
written for general usage.

Londiste
--------

Replication tool written in Python, using PgQ as event transport.

Goals:
- Survive high load, long transactions - implemented in PgQ.
- Easy to administer - eg. tables can be added one-by-one to set.
- Initial COPY does not block event replay for other tables.

Compared to Slony-I it is not that featureful, no support for
chained replication, even support for sequences got added
only recently.


walmgr
------
This script will setup WAL archiving, does initial backup and
runtime WAL archive and restore.




pgsql-announce by date:

Previous
From: Toru SHIMOGAKI
Date:
Subject: pg_bulkload released
Next
From: Federico
Date:
Subject: Italian PGDay 2007 Call For Papers