Guys,
As it turned out, my worst fears came true last night.
The machine which is hosting the search, had bad memory, and crashed
while crawling one of the incremental runs on archives. This in turn
caused filesystem corruption on the reverse index, which has made the
database more or less useless.
I've reindexed all of the websites except for archives, which will take
about a week to complete at the current speed.
Until it has finished, searching the archives is likely to return odd
results, and searching on www.search will not include the archives.
A backup strategy was not in place due to reorganisation of the
hardware/vm's, tho it will be over the next few weeks.
... John
