Re: Email not searchable in our archives - Mailing list pgsql-www

From Magnus Hagander
Subject Re: Email not searchable in our archives
Date
Msg-id 20080312153226.GP29649@svr2.hagander.net
Whole thread Raw
In response to Re: Email not searchable in our archives  ("Dave Page" <dpage@pgadmin.org>)
List pgsql-www
On Wed, Mar 12, 2008 at 03:25:00PM +0000, Dave Page wrote:
> On Wed, Mar 12, 2008 at 2:14 PM, Dave Page <dpage@pgadmin.org> wrote:
> >  Confirmed. I added a test mode to a copy of the archives indexer, and
> >  running that it claims it would index a further 715 messages, which
> >  would give us a total of 1187.
> >
> >  So I guess the next step is to try running out of test mode to see if
> >  the data actually makes it into the index now, but I didn't want to do
> >  that and stomp on any testing you're doing.
> 
> OK, so running it properly has added those missing 715 messages. I
> think we need to run a full index run which should restore any missing
> pages, but before we do that, I'd kinda like to gather any ideas on
> why this has happened before removing any evidence.
> 
> My best guess is simply that the indexer failed for some time and
> noone noticed for a few weeks. By the time it was re-run, some
> messages that it had missed were outside the timeframe that an
> incremental crawl would have picked up (the current, plus last month).
> Thoughts?
> 
> Stefan; any thoughts on how we might monitor that the indexer has been
> running correctly? I assume that should be fairly easy if we have it
> drop a timestamp someplace?

I admint to having a ticket on pmt to get that set up.

Actually, it might be better to look into the actual database, and find the
latest email indexed? If it's older than <nn> something is wrong. It oculd
be the archives that's wrong and not indexer of course, but the point is
we'll get notified and someone can look into it.

Do you think we need to track it on a per-list basis, or just check for the
latest timestamp across all lists?

//Magnus


pgsql-www by date:

Previous
From: Stefan Kaltenbrunner
Date:
Subject: Re: Email not searchable in our archives
Next
From: Tom Lane
Date:
Subject: Re: Email not searchable in our archives