Commit 3bf4c3fb4f3fda33065290cfc3504b221af9ec3c
- Date: Sun Feb 24 22:12:57 +0000 2008
- Committer: Johan Sørensen (johan@johansorensen.com)
- Author: Johan Sørensen (johan@johansorensen.com)
- Commit SHA1: 3bf4c3fb4f3fda33065290cfc3504b221af9ec3c
- Tree SHA1: 527b546784852703ec3397f2e057b248ac79d286
disallow robots indexing of projects, for now
Commit diff
| | |
| 5 | 5 | # Disallow: / |
| 6 | 6 | |
| 7 | 7 | User-agent: * |
| 8 | | Disallow: /projects/*/repos/*/raw/*/ |
| 8 | Disallow: /projects/ |
| toggle raw diff |
--- a/public/robots.txt
+++ b/public/robots.txt
@@ -5,4 +5,4 @@
# Disallow: /
User-agent: *
-Disallow: /projects/*/repos/*/raw/*/
\ No newline at end of file
+Disallow: /projects/
\ No newline at end of file |
