Re: once more: documentation search indexing - Mailing list pgsql-www

From Daniel Gustafsson
Subject Re: once more: documentation search indexing
Date
Msg-id 53CEE7A7-56A2-43A7-950E-521135137456@yesql.se
Whole thread Raw
In response to Re: once more: documentation search indexing  (Peter Geoghegan <pg@bowt.ie>)
Responses Re: once more: documentation search indexing
List pgsql-www
> On 14 Apr 2022, at 05:35, Peter Geoghegan <pg@bowt.ie> wrote:
>
> On Wed, Apr 13, 2022 at 8:19 PM Jonathan S. Katz <jkatz@postgresql.org> wrote:
>> I can look at overall traffic to docs. From a period from Mar 21 - Apr
>> 13, traffic to docs is up 6.78% vs. Feb 25 - Mar 20. So it seems OK at a
>> high level.
>
> Have you thought about using robots.txt to forbid Google from indexing
> versions of Postgres that are now out of support?

robots.txt won't keep Google from indexing the page, if it's linked to from
anywhere on the web it will still appear in the index and search results.

If we want to keep outdated version away from the search results they need a
noindex attribute in <head>:

    <meta name="robots" content="noindex">

--
Daniel Gustafsson        https://vmware.com/




pgsql-www by date:

Previous
From: Peter Geoghegan
Date:
Subject: Re: once more: documentation search indexing
Next
From: Peter Geoghegan
Date:
Subject: Re: once more: documentation search indexing