Thread: List search broken?
List search isn't returning some messages I'd expect it to. For example, if I use Advanced Search to search for "infinity" in all mailing lists and sort by date, I don't see either of the following messages, which do contain the word "infinity": http://archives.postgresql.org/pgsql-general/2006-02/msg00848.php http://archives.postgresql.org/pgsql-hackers/2006-02/msg00919.php Is something amiss? -- Michael Fuhr
Michael Fuhr <mike@fuhr.org> writes:
> List search isn't returning some messages I'd expect it to. For
> example, if I use Advanced Search to search for "infinity" in all
> mailing lists and sort by date, I don't see either of the following
> messages, which do contain the word "infinity":
Now that you mention it, I was having similar problems a day or two
ago --- a message that should have been found in Advanced Search was
not. I forget what I was using as search key though.
regards, tom lane
btw, you could always use pgsql.ru/db/mw
Oleg
On Thu, 23 Feb 2006, Tom Lane wrote:
> Michael Fuhr <mike@fuhr.org> writes:
>> List search isn't returning some messages I'd expect it to. For
>> example, if I use Advanced Search to search for "infinity" in all
>> mailing lists and sort by date, I don't see either of the following
>> messages, which do contain the word "infinity":
>
> Now that you mention it, I was having similar problems a day or two
> ago --- a message that should have been found in Advanced Search was
> not. I forget what I was using as search key though.
>
> regards, tom lane
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster
>
Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
Sternberg Astronomical Institute, Moscow University, Russia
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(495)939-16-83, +007(495)939-23-83
On Thu, Feb 23, 2006 at 09:56:29PM +0300, Oleg Bartunov wrote: > btw, you could always use pgsql.ru/db/mw Or groups.google.com, but the search function on the main site ought to work. Failing outright might be better than returning a partial result; at least you'd know something was wrong. I only noticed that search wasn't working because I was looking for specific messages that I remembered seeing and search wasn't finding them. -- Michael Fuhr
Michael Fuhr wrote: > On Thu, Feb 23, 2006 at 09:56:29PM +0300, Oleg Bartunov wrote: >> btw, you could always use pgsql.ru/db/mw > > Or groups.google.com, but the search function on the main site ought > to work. Failing outright might be better than returning a partial > result; at least you'd know something was wrong. I only noticed > that search wasn't working because I was looking for specific > messages that I remembered seeing and search wasn't finding them. It should be noted that we are in the middle of migrating search to a new machine. Joshua D. Drake -- The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564 PostgreSQL Replication, Consulting, Custom Development, 24x7 support Managed Services, Shared and Dedicated Hosting Co-Authors: plPHP, plPerlNG - http://www.commandprompt.com/
On Thu, Feb 23, 2006 at 02:21:35PM -0700, Michael Fuhr wrote: > On Thu, Feb 23, 2006 at 09:56:29PM +0300, Oleg Bartunov wrote: > > btw, you could always use pgsql.ru/db/mw > > Or groups.google.com, but the search function on the main site ought > to work. Failing outright might be better than returning a partial > result; at least you'd know something was wrong. I only noticed > that search wasn't working because I was looking for specific > messages that I remembered seeing and search wasn't finding them. ISTM this problem has existed forever, though I always just attributed it to me not being able to remember exact phrases. But maybe the search engine itself just has serious issues... -- Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com Pervasive Software http://pervasive.com work: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461
On Thu, 23 Feb 2006, Jim C. Nasby wrote: > On Thu, Feb 23, 2006 at 02:21:35PM -0700, Michael Fuhr wrote: >> On Thu, Feb 23, 2006 at 09:56:29PM +0300, Oleg Bartunov wrote: >>> btw, you could always use pgsql.ru/db/mw >> >> Or groups.google.com, but the search function on the main site ought >> to work. Failing outright might be better than returning a partial >> result; at least you'd know something was wrong. I only noticed >> that search wasn't working because I was looking for specific >> messages that I remembered seeing and search wasn't finding them. > > ISTM this problem has existed forever, though I always just attributed > it to me not being able to remember exact phrases. But maybe the search > engine itself just has serious issues... Just curious, but if you search google, is it picking all the threads properly? is it just search.postgresql.org that is losing the archives, or all search engines? ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664
On Thu, Feb 23, 2006 at 08:20:29PM -0400, Marc G. Fournier wrote: > Just curious, but if you search google, is it picking all the threads > properly? is it just search.postgresql.org that is losing the archives, > or all search engines? Google Groups seems to work; so does the site Oleg mentioned. From what I've seen only search.postgresql.org has a problem. -- Michael Fuhr
On Thu, 23 Feb 2006, Michael Fuhr wrote: > On Thu, Feb 23, 2006 at 08:20:29PM -0400, Marc G. Fournier wrote: >> Just curious, but if you search google, is it picking all the threads >> properly? is it just search.postgresql.org that is losing the archives, >> or all search engines? > > Google Groups seems to work; so does the site Oleg mentioned. From > what I've seen only search.postgresql.org has a problem. Right, but nether Google Groups, nor Oleg's site, search http://archives.postgresql.org ... isn't there a way of telling Google to search for results only on site http://archives.postgresql.org? What I'm more curious about is whether there is a problem with the ASPseek stuff, or is there a problem with archives itself that the search engines aren't picking up those pages you mention are missing, altho they do show up when one does a physical check of them ... ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664
> > Right, but nether Google Groups, nor Oleg's site, search > http://archives.postgresql.org ... isn't there a way of telling Google > to search for results only on site http://archives.postgresql.org? > What I'm more curious about is whether there is a problem with the > ASPseek stuff, or is there a problem with archives itself that the > search engines aren't picking up those pages you mention are missing, > altho they do show up when one does a physical check of them ... site:archives.postgresql.org infinity In the google search box. > > ---- > Marc G. Fournier Hub.Org Networking Services > (http://www.hub.org) > Email: scrappy@hub.org Yahoo!: yscrappy ICQ: > 7615664 > > ---------------------------(end of broadcast)--------------------------- > TIP 4: Have you searched our list archives? > > http://archives.postgresql.org -- The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564 PostgreSQL Replication, Consulting, Custom Development, 24x7 support Managed Services, Shared and Dedicated Hosting Co-Authors: PLphp, PLperl - http://www.commandprompt.com/
On Thu, Feb 23, 2006 at 07:24:33PM -0800, Joshua D. Drake wrote: > >Right, but nether Google Groups, nor Oleg's site, search > >http://archives.postgresql.org ... isn't there a way of telling Google > >to search for results only on site http://archives.postgresql.org? > >What I'm more curious about is whether there is a problem with the > >ASPseek stuff, or is there a problem with archives itself that the > >search engines aren't picking up those pages you mention are missing, > >altho they do show up when one does a physical check of them ... > > site:archives.postgresql.org infinity > > In the google search box. If Google (as opposed to Google Groups) doesn't find a recent page then it's hard to know whether Google had trouble indexing that page or if they haven't attempted to index it yet. Does anybody know how fast Google usually finds new messages in the archives? The most recent message I found from myself on Google was from 11 Feb, so if they're usually faster then maybe that can narrow down when the problem started. Do the web server logs show anything interesting? archives.postgresql.org appears to stop on 17 Feb; searching for common words like "select" and names of frequent posters doesn't find anything newer than that. Maybe that's an additional clue about when something went awry. -- Michael Fuhr
> archives.postgresql.org appears to stop on 17 Feb; searching for > common words like "select" and names of frequent posters doesn't > find anything newer than that. Maybe that's an additional clue > about when something went awry. > > rsync: send_files failed to open "/sfpug/2002-10/.mhonarc.db" (in pgsql-archives): Permission denied (13) rsync: send_files failed to open "/sfpug/2002-11/.mhonarc.db" (in pgsql-archives): Permission denied (13) rsync: send_files failed to open "/sfpug/2002-12/.mhonarc.db" (in pgsql-archives): Permission denied (13) rsync: send_files failed to open "/sfpug/2003-01/.mhonarc.db" (in pgsql-archives): Permission denied (13) rsync: send_files failed to open "/sfpug/2003-02/.mhonarc.db" (in pgsql-archives): Permission denied (13) rsync: send_files failed to open "/sfpug/2003-03/.mhonarc.db" (in pgsql-archives): Permission denied (13) rsync: send_files failed to open "/sfpug/2003-04/.mhonarc.db" (in pgsql-archives): Permission denied (13) I am getting permission errors when pulling the archives. Joshua D. Drake -- The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564 PostgreSQL Replication, Consulting, Custom Development, 24x7 support Managed Services, Shared and Dedicated Hosting Co-Authors: PLphp, PLperl - http://www.commandprompt.com/
those are standard errors and shouldn't be affecting your pulling the archives ... those files aren't *part* of the archives, only administrative stuff for mhonarc itself ... On Thu, 23 Feb 2006, Joshua D. Drake wrote: > >> archives.postgresql.org appears to stop on 17 Feb; searching for >> common words like "select" and names of frequent posters doesn't >> find anything newer than that. Maybe that's an additional clue >> about when something went awry. >> >> > rsync: send_files failed to open "/sfpug/2002-10/.mhonarc.db" (in > pgsql-archives): Permission denied (13) > rsync: send_files failed to open "/sfpug/2002-11/.mhonarc.db" (in > pgsql-archives): Permission denied (13) > rsync: send_files failed to open "/sfpug/2002-12/.mhonarc.db" (in > pgsql-archives): Permission denied (13) > rsync: send_files failed to open "/sfpug/2003-01/.mhonarc.db" (in > pgsql-archives): Permission denied (13) > rsync: send_files failed to open "/sfpug/2003-02/.mhonarc.db" (in > pgsql-archives): Permission denied (13) > rsync: send_files failed to open "/sfpug/2003-03/.mhonarc.db" (in > pgsql-archives): Permission denied (13) > rsync: send_files failed to open "/sfpug/2003-04/.mhonarc.db" (in > pgsql-archives): Permission denied (13) > > I am getting permission errors when pulling the archives. > > Joshua D. Drake > > > > -- > The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564 > PostgreSQL Replication, Consulting, Custom Development, 24x7 support > Managed Services, Shared and Dedicated Hosting > Co-Authors: PLphp, PLperl - http://www.commandprompt.com/ > > ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664
On Thu, 23 Feb 2006, Marc G. Fournier wrote: > On Thu, 23 Feb 2006, Michael Fuhr wrote: > >> On Thu, Feb 23, 2006 at 08:20:29PM -0400, Marc G. Fournier wrote: >>> Just curious, but if you search google, is it picking all the threads >>> properly? is it just search.postgresql.org that is losing the archives, >>> or all search engines? >> >> Google Groups seems to work; so does the site Oleg mentioned. From >> what I've seen only search.postgresql.org has a problem. > > Right, but nether Google Groups, nor Oleg's site, search > http://archives.postgresql.org ... isn't there a way of telling Google to Marc, you miss menu to restrict search http://pgsql.ru/db/pgsearch/, but this is static index Also, http://pgsql.ru/db/mw/ - is an online ! index of all messages our robot subscribed. > search for results only on site http://archives.postgresql.org? What I'm > more curious about is whether there is a problem with the ASPseek stuff, or > is there a problem with archives itself that the search engines aren't > picking up those pages you mention are missing, altho they do show up when > one does a physical check of them ... If people search recent messages, they could just not yet indexed ? > > ---- > Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) > Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664 > Regards, Oleg _____________________________________________________________ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/ phone: +007(495)939-16-83, +007(495)939-23-83
After receiving this email, I stopped the auto sync, and did a manual sync.... These two files became available on archives.postgresql.org in the hour preceeding this email, and as such would not yetbe indexed. (they were among the files rsync'ed across after I stopped the auto sync) Remember, it can take as long as an hour before an email listed on archives.postgresql.org appears in the search. ... John > -----Original Message----- > From: pgsql-www-owner@postgresql.org > [mailto:pgsql-www-owner@postgresql.org] On Behalf Of Michael Fuhr > Sent: Friday, February 24, 2006 4:32 AM > To: pgsql-www@postgresql.org > Subject: [pgsql-www] List search broken? > > List search isn't returning some messages I'd expect it to. > For example, if I use Advanced Search to search for > "infinity" in all mailing lists and sort by date, I don't see > either of the following messages, which do contain the word > "infinity": > > http://archives.postgresql.org/pgsql-general/2006-02/msg00848.php > http://archives.postgresql.org/pgsql-hackers/2006-02/msg00919.php > > Is something amiss? > > -- > Michael Fuhr > > ---------------------------(end of > broadcast)--------------------------- > TIP 4: Have you searched our list archives? > > http://archives.postgresql.org > >
On Fri, Feb 24, 2006 at 08:48:50PM +1100, John Hansen wrote: > After receiving this email, I stopped the auto sync, and did a > manual sync.... > > These two files became available on archives.postgresql.org in the > hour preceeding this email, and as such would not yet be indexed. > > (they were among the files rsync'ed across after I stopped the auto > sync) Has the problem with auto sync been identified? If not then it'll probably happen again, and it'll be a while again before anybody notices. > Remember, it can take as long as an hour before an email listed on > archives.postgresql.org appears in the search. Understood, but search wasn't finding anything newer than 17 Feb, which was approaching a week. Thanks for taking care of it. -- Michael Fuhr