Thread: Websites

Websites

From
"John Hansen"
Date:
Marc, Dave, webmasters et al...

Just a thought, it might be a good idea to add robots.txt entries to the
sites, so that pages like:
http://developer.postgresql.org/docs/pgsql/src/test/regress/expected/flo
at4-exp-three-digits.out
are not indexed.

Including cvsweb interfaces, as was pointed out on IRC almost took down
the new server when google hit it.

Regards,

John