Browse Source

add verbose search to robots.txt

This was missing in the first place.

Signed-off-by: Natalie Pendragon <natpen@natpen.net>
master
René Wagner 8 months ago
committed by Natalie Pendragon
parent
commit
4817ab3149
  1. 1
      serve/views.py

1
serve/views.py

@ -63,6 +63,7 @@ def status(request):
"""User-agent: researcher
User-agent: indexer
User-agent: archiver
Disallow: /v/search
Disallow: /search
Disallow: /backlinks

Loading…
Cancel
Save