[gtk-web] Avoid indexing old GTK+ API references

[Matthias Clasen <matthiasc src gnome org>]

commit 78b5d6cff547a8f8d826cf78fe81f9451383feed
Author: Matthias Clasen <mclasen redhat com>
Date:   Mon Mar 10 06:48:38 2014 -0400

    Avoid indexing old GTK+ API references
    
    Proposed by David King in
    https://bugzilla.gnome.org/show_bug.cgi?id=723244

 robots.txt |    2 ++
 1 files changed, 2 insertions(+), 0 deletions(-)
---
diff --git a/robots.txt b/robots.txt
new file mode 100644
index 0000000..d5aa00c
--- /dev/null
+++ b/robots.txt
@@ -0,0 +1,2 @@
+User-agent: *
+Disallow: /api/ # Do not index old API references