Bill Fenner
|
ed17c90019
|
Rule out the /cgi-bin/wg/ scripts too, as they've shown up on the
error list.
- Legacy-Id: 914
|
2007-07-31 17:09:25 +00:00 |
|
Henrik Levkowetz
|
0108dc0617
|
Adding the multiple-db-entry drafts to robots.txt until we've fixed the db.
- Legacy-Id: 884
|
2007-07-11 19:15:43 +00:00 |
|
|
Henrik Levkowetz
|
a2d85a931b
|
Tell robots there's no idea going to the password-protected /cgi-bin/idtracker.cgi. There are more script under .cgi, but this particular one pops up in Google's HTTP error page list.
- Legacy-Id: 880
|
2007-07-09 21:13:13 +00:00 |
|
|
Henrik Levkowetz
|
a75e7be5a8
|
Adding a nearly empty robots.txt file (see #197). Apache needs to be told to serve /robots.txt as a static file to complete this.
- Legacy-Id: 869
|
2007-07-09 13:54:06 +00:00 |
|