[static-web] Disallow DotBot indexing

[Andrea Veri <av src gnome org>]

commit cc94cde56083dc7084c704c7b78b5c1c5f6ee6fa
Author: Andrea Veri <av gnome org>
Date:   Sat Oct 4 14:47:50 2014 +0200

    Disallow DotBot indexing

 wiki.gnome.org/robots.txt |    3 +++
 1 files changed, 3 insertions(+), 0 deletions(-)
---
diff --git a/wiki.gnome.org/robots.txt b/wiki.gnome.org/robots.txt
index 2986279..548bb06 100644
--- a/wiki.gnome.org/robots.txt
+++ b/wiki.gnome.org/robots.txt
@@ -1,5 +1,8 @@
 # if you want to add own robot rules, do it BEFORE the final rule matching *
 
+User-agent: dotbot
+Disallow: /
+
 User-agent: *
 Crawl-delay: 20
 # This has to match script url + cfg.url_prefix_action - it