Thread: duplicate messages?

duplicate messages?

From
Robert Treat
Date:
Anyone else getting duplicate messages?  I seem to be getting them
sporadically on different messages on pgsql-general.  Seems to have started
sometime Monday morning (estern us time)

--
Robert Treat
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL

Re: duplicate messages?

From
Audrey Bergeron-Morin
Date:
> Anyone else getting duplicate messages?

Yep, have been getting them sporadically ever since I
joined (about 5 weeks ago). It's something that
happens once in a while on many mailing lists, I
wouldn't worry about it unless it becomes a regular occurence.

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around
http://mail.yahoo.com

Re: duplicate messages?

From
"Greg Sabino Mullane"
Date:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


> Anyone else getting duplicate messages?  I seem to be getting them
> sporadically on different messages on pgsql-general.  Seems to have started
> sometime Monday morning (estern us time)

One reason this happens is because people post to the list from an address
which is not subscribed. Their message gets addded the moderator's queue.
They then realize that they were not subscribed, and either subscribe
and send again, or send from another account, or send again so it gets
added to the moderator's queue multiple times. The moderator comes along and
approves the message(s) at some point. Thus, duplicate messages. In an ideal
world, the moderator or the original poster is constantly reading the list
and realized the post has already made it. Of course, in an ideal world,
people would subscribe to the list before attempting to send to it. :)

- --
Greg Sabino Mullane greg@turnstep.com
PGP Key: 0x14964AC8 200507271007
https://www.biglumber.com/x/web?pk=2529DF6AB8F79407E94445B4BC9B906714964AC8

-----BEGIN PGP SIGNATURE-----

iEYEARECAAYFAkLnlU8ACgkQvJuQZxSWSsjwpwCgxKKjWvtud1UdVUpkhMvEsO1x
foUAniDRZxc0VQRKkwXzt9Gq/EH1SNIr
=FiHA
-----END PGP SIGNATURE-----



Re: duplicate messages?

From
Robert Treat
Date:
On Wed, 2005-07-27 at 10:09, Greg Sabino Mullane wrote:
>
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
>
> > Anyone else getting duplicate messages?  I seem to be getting them
> > sporadically on different messages on pgsql-general.  Seems to have started
> > sometime Monday morning (estern us time)
>
> One reason this happens is because people post to the list from an address
> which is not subscribed. Their message gets addded the moderator's queue.
> They then realize that they were not subscribed, and either subscribe
> and send again, or send from another account, or send again so it gets
> added to the moderator's queue multiple times. The moderator comes along and
> approves the message(s) at some point. Thus, duplicate messages. In an ideal
> world, the moderator or the original poster is constantly reading the list
> and realized the post has already made it. Of course, in an ideal world,
> people would subscribe to the list before attempting to send to it. :)
>

Seems unlikely unless folks like Tom Lane, Stephan Szabo, and Richard
Huxton have unsubscribed and resubscribed lately... Funny thing is it
isnt every messages, but maybe half of them. And its not to specific
users, sometimes one of Toms emails will duplicate but sometimes not.
Further more it only seems to be happening on pgsql-general emails and
not on any of the other lists... I also notice this is only happening on
one of my subscribed emails, not the other, which is a little weird...
according to the headers though, this problem is happening further
upstream.


Robert Treat
--
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL


Re: duplicate messages?

From
Steve Atkins
Date:
On Wed, Jul 27, 2005 at 11:46:05AM -0400, Robert Treat wrote:
> > > Anyone else getting duplicate messages?  I seem to be getting them
> > > sporadically on different messages on pgsql-general.  Seems to have started
> > > sometime Monday morning (estern us time)
> >
> > One reason this happens is because people post to the list from an address
> > which is not subscribed. Their message gets addded the moderator's queue.
> > They then realize that they were not subscribed, and either subscribe
> > and send again, or send from another account, or send again so it gets
> > added to the moderator's queue multiple times. The moderator comes along and
> > approves the message(s) at some point. Thus, duplicate messages. In an ideal
> > world, the moderator or the original poster is constantly reading the list
> > and realized the post has already made it. Of course, in an ideal world,
> > people would subscribe to the list before attempting to send to it. :)
> >
>
> Seems unlikely unless folks like Tom Lane, Stephan Szabo, and Richard
> Huxton have unsubscribed and resubscribed lately... Funny thing is it
> isnt every messages, but maybe half of them. And its not to specific
> users, sometimes one of Toms emails will duplicate but sometimes not.
> Further more it only seems to be happening on pgsql-general emails and
> not on any of the other lists... I also notice this is only happening on
> one of my subscribed emails, not the other, which is a little weird...
> according to the headers though, this problem is happening further
> upstream.

It happens every so often (I've noticed it 4 or 5 times in the past
few years). If you check the headers you'll probably find the dupes
come from one particular server. It appears to be multiple delivery
rather than reinjection of articles to the list.

Cheers,
  Steve

Re: duplicate messages?

From
Bruno Wolff III
Date:
On Wed, Jul 27, 2005 at 11:46:05 -0400,
  Robert Treat <xzilla@users.sourceforge.net> wrote:
>
> Seems unlikely unless folks like Tom Lane, Stephan Szabo, and Richard
> Huxton have unsubscribed and resubscribed lately... Funny thing is it
> isnt every messages, but maybe half of them. And its not to specific
> users, sometimes one of Toms emails will duplicate but sometimes not.
> Further more it only seems to be happening on pgsql-general emails and
> not on any of the other lists... I also notice this is only happening on
> one of my subscribed emails, not the other, which is a little weird...
> according to the headers though, this problem is happening further
> upstream.

Are some copies of these messages being sent directly to you without going
through the list? If so there is a way to tell the list server not to
send you copies if it appears you are getting a copy directly from the
sender.

Re: duplicate messages?

From
Alvaro Herrera
Date:
On Wed, Jul 27, 2005 at 11:46:05AM -0400, Robert Treat wrote:

> Seems unlikely unless folks like Tom Lane, Stephan Szabo, and Richard
> Huxton have unsubscribed and resubscribed lately... Funny thing is it
> isnt every messages, but maybe half of them. And its not to specific
> users, sometimes one of Toms emails will duplicate but sometimes not.
> Further more it only seems to be happening on pgsql-general emails and
> not on any of the other lists... I also notice this is only happening on
> one of my subscribed emails, not the other, which is a little weird...
> according to the headers though, this problem is happening further
> upstream.

I'd think it would be a problem with your "last mile", because it seems
to be a localized problem.  Maybe an SMTP server dropping connections at
the last moment, or a deliver program crashing after delivering (leading
to re-delivery), or something like that.

You'd have to show us the headers though.

--
Alvaro Herrera (<alvherre[a]alvh.no-ip.org>)
"Find a bug in a program, and fix it, and the program will work today.
Show the program how to find and fix a bug, and the program
will work forever" (Oliver Silfridge)

Re: duplicate messages?

From
Robert Treat
Date:
On Wednesday 27 July 2005 12:30, Alvaro Herrera wrote:
> On Wed, Jul 27, 2005 at 11:46:05AM -0400, Robert Treat wrote:
> > Seems unlikely unless folks like Tom Lane, Stephan Szabo, and Richard
> > Huxton have unsubscribed and resubscribed lately... Funny thing is it
> > isnt every messages, but maybe half of them. And its not to specific
> > users, sometimes one of Toms emails will duplicate but sometimes not.
> > Further more it only seems to be happening on pgsql-general emails and
> > not on any of the other lists... I also notice this is only happening on
> > one of my subscribed emails, not the other, which is a little weird...
> > according to the headers though, this problem is happening further
> > upstream.
>
> I'd think it would be a problem with your "last mile", because it seems
> to be a localized problem.  Maybe an SMTP server dropping connections at
> the last moment, or a deliver program crashing after delivering (leading
> to re-delivery), or something like that.
>
> You'd have to show us the headers though.

I would think that too, however take a look at these message headers:
the critical piece seems to be the handoff between postgresql.org and
commandprompt, where the ESMTP changes into j6RGoF0u002162 and j6RGj9mu001662
for what would otherwise be the same message.

 Received: from 128.commandprompt.com ([207.173.200.128]
helo=hosting.commandprompt.com)
        by mail.sourceforge.net with esmtps (TLSv1:AES256-SHA:256)
        (Exim 4.44)
        id 1DxpLy-00015W-19
        for xzilla@users.sourceforge.net; Wed, 27 Jul 2005 10:06:01 -0700
 Received: from postgresql.org (svr1.postgresql.org [200.46.204.71])
        by hosting.commandprompt.com (8.13.4/8.13.4) with ESMTP id
j6RGj9mu001662;
        Wed, 27 Jul 2005 09:45:27 -0700
 X-Original-To: pgsql-general-postgresql.org@localhost.postgresql.org
 Received: from localhost (unknown [200.46.204.144])
        by svr1.postgresql.org (Postfix) with ESMTP id 9F4A852F9D
        for <pgsql-general-postgresql.org@localhost.postgresql.org>; Wed, 27
Jul 2005 13:30:42 -0300 (ADT)
 Received: from svr1.postgresql.org ([200.46.204.71])
 by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024)
 with ESMTP id 01459-09
 for <pgsql-general-postgresql.org@localhost.postgresql.org>;
 Wed, 27 Jul 2005 16:30:37 +0000 (GMT)
 Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.200])
        by svr1.postgresql.org (Postfix) with ESMTP id E8ECB52FA4
        for <pgsql-general@postgresql.org>; Wed, 27 Jul 2005 13:30:36 -0300
(ADT)
 Received: by wproxy.gmail.com with SMTP id i21so208751wra
        for <pgsql-general@postgresql.org>; Wed, 27 Jul 2005 09:30:36 -0700
(PDT)
 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;

h=received:message-id:date:from:reply-to:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references;

b=nNBziaFbsTlwduR3PYyrUPubs6NRt0AU0/m8aPBQkXbpYYNqBRefNf0io5qZhG4oMSf3FnUwJoNlAfMdHG/R9CKm6XKb0eik8nEBDMcA6DYmBJsbLM3ebzFe6lzilfwxvtMYhSH8SohIDoHPX/CEyLxldB0sDmDLCu6YFXBv3Yg=
 Received: by 10.54.13.59 with SMTP id 59mr411070wrm;
        Wed, 27 Jul 2005 09:30:36 -0700 (PDT)
 Received: by 10.54.100.12 with HTTP; Wed, 27 Jul 2005 09:30:36 -0700 (PDT)
 Message-ID: <7256023005072709305aee5839@mail.gmail.com>
---
 Received: from 128.commandprompt.com ([207.173.200.128]
helo=hosting.commandprompt.com)
        by mail.sourceforge.net with esmtps (TLSv1:AES256-SHA:256)
        (Exim 4.44)
        id 1DxpQt-0003vz-Tr
        for xzilla@users.sourceforge.net; Wed, 27 Jul 2005 10:11:05 -0700
 Received: from postgresql.org (svr1.postgresql.org [200.46.204.71])
        by hosting.commandprompt.com (8.13.4/8.13.4) with ESMTP id
j6RGoF0u002162;
        Wed, 27 Jul 2005 09:50:15 -0700
 X-Original-To: pgsql-general-postgresql.org@localhost.postgresql.org
 Received: from localhost (unknown [200.46.204.144])
        by svr1.postgresql.org (Postfix) with ESMTP id 9F4A852F9D
        for <pgsql-general-postgresql.org@localhost.postgresql.org>; Wed, 27
Jul 2005 13:30:42 -0300 (ADT)
 Received: from svr1.postgresql.org ([200.46.204.71])
 by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024)
 with ESMTP id 01459-09
 for <pgsql-general-postgresql.org@localhost.postgresql.org>;
 Wed, 27 Jul 2005 16:30:37 +0000 (GMT)
 Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.200])
        by svr1.postgresql.org (Postfix) with ESMTP id E8ECB52FA4
        for <pgsql-general@postgresql.org>; Wed, 27 Jul 2005 13:30:36 -0300
(ADT)
 Received: by wproxy.gmail.com with SMTP id i21so208751wra
        for <pgsql-general@postgresql.org>; Wed, 27 Jul 2005 09:30:36 -0700
(PDT)
 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;

h=received:message-id:date:from:reply-to:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references;

b=nNBziaFbsTlwduR3PYyrUPubs6NRt0AU0/m8aPBQkXbpYYNqBRefNf0io5qZhG4oMSf3FnUwJoNlAfMdHG/R9CKm6XKb0eik8nEBDMcA6DYmBJsbLM3ebzFe6lzilfwxvtMYhSH8SohIDoHPX/CEyLxldB0sDmDLCu6YFXBv3Yg=
 Received: by 10.54.13.59 with SMTP id 59mr411070wrm;
        Wed, 27 Jul 2005 09:30:36 -0700 (PDT)
 Received: by 10.54.100.12 with HTTP; Wed, 27 Jul 2005 09:30:36 -0700 (PDT)
 Message-ID: <7256023005072709305aee5839@mail.gmail.com>

--
Robert Treat
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL

Re: duplicate messages?

From
Alvaro Herrera
Date:
On Wed, Jul 27, 2005 at 01:55:51PM -0400, Robert Treat wrote:
> On Wednesday 27 July 2005 12:30, Alvaro Herrera wrote:
> > On Wed, Jul 27, 2005 at 11:46:05AM -0400, Robert Treat wrote:
> > > Seems unlikely unless folks like Tom Lane, Stephan Szabo, and Richard
> > > Huxton have unsubscribed and resubscribed lately... Funny thing is it
> > > isnt every messages, but maybe half of them. And its not to specific
> > > users, sometimes one of Toms emails will duplicate but sometimes not.
> > > Further more it only seems to be happening on pgsql-general emails and
> > > not on any of the other lists... I also notice this is only happening on
> > > one of my subscribed emails, not the other, which is a little weird...
> > > according to the headers though, this problem is happening further
> > > upstream.
> >
> > I'd think it would be a problem with your "last mile", because it seems
> > to be a localized problem.  Maybe an SMTP server dropping connections at
> > the last moment, or a deliver program crashing after delivering (leading
> > to re-delivery), or something like that.
> >
> > You'd have to show us the headers though.
>
> I would think that too, however take a look at these message headers:
> the critical piece seems to be the handoff between postgresql.org and
> commandprompt, where the ESMTP changes into j6RGoF0u002162 and j6RGj9mu001662
> for what would otherwise be the same message.

Strange.  I'd expect that this message had been crossposted to more than one
list, but it isn't.

--
Alvaro Herrera (<alvherre[a]alvh.no-ip.org>)
"Aprende a avergonzarte más ante ti que ante los demás" (Demócrito)

Re: duplicate messages?

From
Paul Tillotson
Date:
Alvaro Herrera wrote:

>On Wed, Jul 27, 2005 at 11:46:05AM -0400, Robert Treat wrote:
>
>
>
>>Seems unlikely unless folks like Tom Lane, Stephan Szabo, and Richard
>>Huxton have unsubscribed and resubscribed lately... Funny thing is it
>>isnt every messages, but maybe half of them. And its not to specific
>>users, sometimes one of Toms emails will duplicate but sometimes not.
>>Further more it only seems to be happening on pgsql-general emails and
>>not on any of the other lists... I also notice this is only happening on
>>one of my subscribed emails, not the other, which is a little weird...
>>according to the headers though, this problem is happening further
>>upstream.
>>
>>
>
>I'd think it would be a problem with your "last mile", because it seems
>to be a localized problem.  Maybe an SMTP server dropping connections at
>the last moment, or a deliver program crashing after delivering (leading
>to re-delivery), or something like that.
>
>You'd have to show us the headers though.
>
>
>
For the last few days, I am getting about half of the messages on
-general in duplicate also. I've attached two messages that I got in
duplicate for header perusal.

It seems kind of unlikely that this should start happening to all of us
at once.

Paul

On Wed, Jul 27, 2005 at 04:46:56PM +0200, denis@edistar.com wrote:
> I'm now testing with pg_pool installed on each apache frontend with 260
> pg_pool preforked clients in each machine.
>
> The database seems to work better. At least when it goes to swap it
> doesn't stop working...

Wait, are you saying your database server is swapping? You'll never get
any kind of performance if that's the case.
--
Jim C. Nasby, Database Consultant               decibel@decibel.org
Give your computer some brain candy! www.distributed.net Team #1828

Windows: "Where do you want to go today?"
Linux: "Where do you want to go tomorrow?"
FreeBSD: "Are you guys coming, or what?"

---------------------------(end of broadcast)---------------------------
TIP 6: explain analyze is your friend


On Wed, Jul 27, 2005 at 04:46:56PM +0200, denis@edistar.com wrote:
> I'm now testing with pg_pool installed on each apache frontend with 260
> pg_pool preforked clients in each machine.
>
> The database seems to work better. At least when it goes to swap it
> doesn't stop working...

Wait, are you saying your database server is swapping? You'll never get
any kind of performance if that's the case.
--
Jim C. Nasby, Database Consultant               decibel@decibel.org
Give your computer some brain candy! www.distributed.net Team #1828

Windows: "Where do you want to go today?"
Linux: "Where do you want to go tomorrow?"
FreeBSD: "Are you guys coming, or what?"

---------------------------(end of broadcast)---------------------------
TIP 6: explain analyze is your friend