spaCy/website/robots.txt.jade
2016-10-31 19:04:15 +01:00

6 lines
86 B
Plaintext

//- 💫 ROBOTS.TXT
if environment != "deploy"
| User-agent: *
| Disallow: /