altf4arnold/datatracker
1
0
Fork 0
Code Issues Pull requests Actions 6 Packages Projects Releases Wiki Activity

Let development and test deployment have a robots.txt which don't permit robots.

Browse source 
- Legacy-Id: 3079
This commit is contained in:
Henrik Levkowetz 2011-05-03 14:05:01 +00:00
parent 14edf23ac1
commit 6fde32b2f5
2 changed files with 2 additions and 12 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
ietf/urls.py
View file

@ -70,5 +70,6 @@ urlpatterns = patterns('',
if settings.SERVER_MODE in ('development', 'test'):
urlpatterns += patterns('',
(r'^(?P<path>(?:images|css|js)/.*)$', 'django.views.static.serve', {'document_root': settings.MEDIA_ROOT}),
(r'^(?P<path>robots\.txt)$', 'django.views.static.serve', {'document_root': settings.MEDIA_ROOT}),
(r'^_test500/$', lambda x: None),
)

13
static/robots.txt
View file

@ -1,13 +1,2 @@
User-agent: *
Disallow: /idtracker/feedback
Disallow: /cgi-bin/idtracker.cgi
Disallow: /cgi-bin/wg/
Disallow: /drafts/draft-ietf-hubmib-etherif-MIB/
Disallow: /drafts/draft-ietf-hubmib-etherif-mib/
Disallow: /drafts/draft-jamoussi-mpls-crldp-applic/
Disallow: /drafts/draft-mavrakis-videotex-url-spec/
Disallow: /drafts/draft-perkins-bits/
Disallow: /drafts/draft-perkins-float/
Disallow: /drafts/draft-rauschenbach-pop3-framework/
Disallow: /drafts/draft-shivkumar-ldapext-dirtxn/
Disallow: /drafts/draft-wu-mpls-multicast-te/
Disallow: /