spaCy/website/robots.txt.jade

6 lines
86 B
Plaintext
Raw Normal View History

2016-10-31 21:04:15 +03:00
//- 💫 ROBOTS.TXT
2016-10-03 21:19:13 +03:00
if environment != "deploy"
| User-agent: *
| Disallow: /