Re: PostgreSQL as advanced job queuing system - Mailing list pgsql-general

From Thiemo Kellner
Subject Re: PostgreSQL as advanced job queuing system
Date
Msg-id 0da7da15-9155-4b53-9d6d-d289fc0986c7@gelassene-pferde.biz
Whole thread Raw
In response to Re: PostgreSQL as advanced job queuing system  (Fred Habash <fmhabash@gmail.com>)
Responses Re: PostgreSQL as advanced job queuing system
List pgsql-general

Am 22.03.2024 um 14:15 schrieb Fred Habash:
> We developed a home-grown queue system using Postgres, but its 
> performance was largely hindered by que tables bloating and the need to 
> continuously vacuum them. It did not scale whatsoever. With some 
> workarounds, we ended up designing three sets of queue tables, switching 
> between them based on some queue stats, vacuum the inactive set, and repeat.
> We kept this queue system for low SLA app components. For others, we 
> switched to Kafka. Investing in learning and implementing purpose built 
> queue systems pays off for the long term.

I wonder whether one should https://youtu.be/VEWXmdjzIpQ&t=543 not to 
scale either.



pgsql-general by date:

Previous
From: Alban Hertroys
Date:
Subject: Re: could not open file "global/pg_filenode.map": Operation not permitted
Next
From: Fred Habash
Date:
Subject: Timing out A Blocker Based on Time or Count of Waiters