mirror of
https://github.com/explosion/spaCy.git
synced 2024-12-27 18:36:36 +03:00
10 lines
142 B
Plaintext
10 lines
142 B
Plaintext
//- 💫 ROBOTS.TXT
|
|
|
|
if environment != "deploy"
|
|
| User-agent: *
|
|
| Disallow: /
|
|
|
|
if ALPHA
|
|
| User-agent: Googlebot
|
|
| Disallow: /
|